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(54) Method and device for integrated multimedia messaging service 



Q. 
LU 



(57) A multimedia messaging service is provided for 
use in a powerful, facilities-based, end-to-end Internet 
Protocol (IP) based network Infrastructure that guaran- 
tees voice, data and video communication reliability and 
security to users for an integrated telephone, television 
and data network. The IP network multimedia messag- 
ing service provides an any-media messaging service 
to its users. The IP network user may send and receive 
mail messages in a variety of formats such as e-mail 
(text), voice mail (audio), or multimedia video mail (au- 
dio and video). A Graphical User Interface (GUI) is pro- 
vided as one means for retrieving a user's stored mail 
messages. The GUI provides the user with a single 
means for identifying and accessing all the various types 
of mail messages which are stored and awaiting review; 
whether the mall message is in e-mail, voice-mail, or 
multimedia video mail format. Further, the system may 
provide the user control of the type of media by which 
the stored mail messages are to be retrieved and re- 
viewed, regardless of the type of media used to create 
and store the message. For example, if a user has an 
e-mail message they can instruct the IP network multi- 
media message service to transform the text of the e- 
mail message Into an audio message using voice syn- 
thesis. Similarly, if a user has an audio voice-mail mes- 
sage the system can transform the audio Into a text (e- 
mail) message using voice recognition. The multimedia 
messaging service of the present invention may also en- 
able a user to sort and/or prioritize mail messages based 
on a variety of user specified criteria such as the senders 



identity, subject matter, date sent, priority specified by 
the sender, etc. The multimedia messaging service may 
include a multimedia message fonwarding feature which 
enables the user to specify a remote location to which 
message waiting notification will be automatically for- 
ward and from which the user may instantaneously re- 
view the message in whatever media the user selects. 
The multimedia messaging service may enable the user 
to store the messages on their own equipment, e.g., 
within a PC or a Broadband Residential Gateway 
(BRG), orto archive the message within the system for 
a fee. The multimedia messaging service may also be 
equipped with a simple user friendly message waiting 
indicator for each I P address and a one touch multime- 
dia messaging service message retrieval feature acti- 
vation. 
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Description 

FIELD OF THE INVENTION 

[0001] The present invention relates to communica- 
tion between users in diverse communication systems, 
and more particularly, to providing a broadband commu- 
nication system Including a messaging service for an In- 
ternet Protocol Telephony Network and public switched 
telephone network. 

BACKGROUND OF THE INVENTION 

[0002] Present day telephony voice networks, have a 
network built around circuit switches, end offices, a toll 
network, tandem switches, and twisted wires. These 
voice networks are referred to as a public switched tel- 
ephone network (PSTN) or plain old telephone service 
(POTS). Due to bandwidth limitations of plain old tele- 
phone service (POTS), there is an inherent inability to 
efficiently integrate multiple types of media such as te- 
lephony, data communication for personal computers 
(PC), and television (TV) broadcasts. Accordingly, a 
new broadband architecture is required. This new archi- 
tecture gives rise to a new array of user services. Plain 
old telephone service (POTS) presently available within 
the PSTN typically have voice mail messaging systems 
that allows the POTS user to subscribe to and receive 
voice mail messages from a central office phone mail 
systems without any means for receiving text or video 
(multimedia) messages. Further, POTS do not have the 
capability to Integrate multiple types of media such as 
telephony, PC using data, and TV, and thus do not have 
multimedia messaging capabilities. 

SUMMARY OF THE INVENTION 

[0003] Aspects of the invention include to providing 
broadband access capabilities or enhanced services for 
use in conjunction with a packetized network such as 
an internet Protocol (IP) based system infrastructure. 
[0004] Other aspects of the invention include provid- 
ing one or more of the following either individually, or in 
any combination or subcombination: 

a new broadband architecture; 
broadband network capabilities, including local ac- 
cess; 

enhanced services for use in conjunction with a 
packetized network such as an Internet Protocol 
(IP) based system infrastructure. One such en- 
hanced service includes a multimedia messaging 

service. 

[0005] The present invention provides for a multime- 
dia messaging service for use in a powerful, facilities- 
based, end-to-end Internet Protocol (IP) based network 
infrastructure that guarantees voice, data and video 



communication reliability and security to users for an in- 
tegrated telephone, television and data network. The I P 
network multimedia messaging service provides an 
any-media messaging service to its users. The IP net- 
5 work user may send and receive mail messages in a 
variety of formats such as e-mail (text), voice mail (au- 
dio), or multimedia video mail (audio and video). A 
Graphical User Interface (GUI) is provided as one 
means for retrieving a user's stored mail messages. The 
10 GUI provldestheuserwith asinglemeansforidentifying 
and accessing all the various types of mail messages 
which are stored and awaiting review; whether the mail 
message is in e-mail, voice-mail, or multimedia video 
mail fonnat. Further, the system may provide the user 
15 control of the type of media by which the stored mail 
messages are to be retrieved and reviewed, regardless 
of the type of media used to create and store the mes- 
sage. For example, If a user has an e-mail message they 
can instruct the IP network multimedia message service 
20 to transform the text of the e-mail message into an audio 
message using voice synthesis. Similarly, if a user has 
an audio voice-mail message the system can transform 
the audio into a text (e-mail) message using voice rec- 
ognition. The multimedia messaging service of the, 
25 present invention may also enable a user to sort and/or 
prioritize mall messages based on a variety of user 
specified criteria such as the senders identity, subject 
matter, date sent, priority specified by the sender, etc. 
The multimedia messaging service may include a mul- 
30 timedia message forwarding feature which enables the 
userto specify a remote location to which message wait- 
ing notification will be automatically forward and from 
which the user may instantaneously review the mes- 
sage in whatever media the user selects. The multime- 
35 dia messaging service may enable the user to store the 
messages on their own equipment, e.g., within a PC or 
a Broadband Residential Gateway (BRG), or to archive 
the message within the system for a fee. The multimedia 
messaging service may also be equipped with a simple 
40 user friendly message waiting indicator for each IP ad- 
dress and a one touch multimedia messaging service 
message retrieval feature activation. 
[0006] Thus, the present invention provides integrat- 
ed multimedia networks, including voice over IP (VoIP), 
45 with a user friendly flexible multimedia messaging serv- 
ice that integrates all types of mail messages so that a 
user can be notified of, identify, retrieve, and store all 
his mall messages with a single service in whatever me- 
dia the user wishes. 
50 [0007] Although the invention has been defined using 
the appended claims, these claims are exemplary and 
limiting to the extent that the invention is meant to in- 
clude one or more elements from the apparatus and 
methods described herein and in the applications incor- 
55 porated by reference in any combination or subcombi- 
nation. Accordingly, there are any number of alternative 
combinations for defining the invention, which incorpo- 
rate one or more elements from the specification (includ- 
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ing the drawings, claims, and applications incorporated 
by reference) in any combinations or subcombinations. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0008] Fig. 1 shows a schematic representation of a 
broadband network (e.g., broadband IP based network) 
In accordance with a preferred embodiment of aspects 
of the present Invention. 

[0009] Fig. 2 shows a block diagram of a preferred 
embodiment of a centralized control (IP central station) 
In accordance with aspects of the present Invention. 
[0010] Fig. 3 shows a block diagram of a preferred 
embodiment of a local control apparatus (broadband 
residential gateway) in accordance with aspects of the 
present Invention. 

[001 1] Fig. 4 shows a detailed schematic representa- 
tion of an exemplary embodiment of the broadband net- 
work shown In Fig. 1. 

[0012] Fig. 5 is a signal flow diagram Illustrating a typ- 
ical on-network to off-network call according to one pre- 
ferred method of operating the broadband network 
shown in Fig. 1 . 

[0013] Fig. 6 is a signal flow diagram Illustrating a typ- 
ical on-network to on-network call according to one pre- 
ferred method of operating the broadband network 

shown in Fig. 1 . 

[0014] Figs. 7A and 7B are process flow diagrams Il- 
lustrating one preferred method for storing messages 
and providing initial notification which Is useful In the 
multimedia messaging service of the present Invention 
operating with a broadband network. 
[0015] Fig. 8A Is a process flow diagram Illustrating 
one preferred method for providing notification of a mes- 
sage(s) waiting which Is useful In the multimedia mes- 
saging service of the present Invention operating with a 
broadband network. 

[0016] Fig. 88 is a process flow diagram illustrating 
one preferred method for providing notification of a mes- 
sage(s) waiting an access of a message log which is 
useful in the multimedia messaging service of the 
present invention operating with a broadband network, 
[0017] Fig. 8C is a process flow diagram illustrating 
one preferred method for providing message retrieval 
and archiving of a message(s) which is useful inthe mul- 
timedia messaging service of the present invention op- 
erating with a broadband network. 
[0018] Fig. 9 provides an Illustration of one exemplary 
graphical user Interface for providing notification of a 
message(s) waiting to a broadband communication sys- 
tem user which Is useful in the multimedia messaging 
service of the present Invention operating with a broad- 
band network. 

[0019] Fig. 10 provides an illustration of one exempla- 
ry graphical user interface for providing multimedia mes- 
saging service login and a message waiting notification 
to a broadband communication system user which Is 
useful In the multimedia messaging service of the 



present invention operating with a broadband network. 
[0020] Fig. 11 is a process flow diagram illustrating 
one preferred method for providing message media type 
conversion capability which is useful in the multimedia 
messaging service of the present invention operating 
with a broadband network. 

[0021] Fig. 12 provides an illustration of one exempla- 
ry graphical user Interface for providing message media 
type conversion capability which Is useful in the multi- 
media messaging service of the present Invention oper- 
ating with a broadband network. 
[0022] Fig. 13 provides an Illustration of one exempla- 
ry graphical user Interface forproviding message sorting 
and prioritizing capability which Is useful In the multime- 
dia messaging service of the present Invention operat- 
ing with a broadband network. 
[0023] Fig. 14 Is a process flow diagram Illustrating 
one preferred method for providing remote message 
waiting notification capability which is useful In the mul- 
timedia messaging service of the present Invention op- 
erating with a broadband network. 
[0024] Fig. 15 provides an illustration of one exempla- 
ry graphical user interface for providing message notifi- 
cation location selection capability which is useful in the 
multimedia messaging service of the present invention 
operating with a broadband network. 
[0025] Fig. 1 6 provides an Illustration of one exempla- 
ry graphical user Interface for providing message stor- 
age selection capability which Is useful inthe multimedia 
messaging service of the present Invention operating 
with a broadband network. 



[0026] The present Invention provides a user friendly 
flexible multimedia messaging service that integrates all 
types of mail messages, e.g., e-mail (text), voice-mail 
(audio) and multimedia video mail (audio and video), so 
that a user can be notified, identify, retrieve, and store 
all his mail messages with a single service in whatever 
media the user wishes. This multimedia messaging 
service which maybe provided in a broadband IP based 
integrated communication system may include various 
methods of message waiting notification, user secure 
log in, message type conversion, message sort and pri- 
oritizing, user programmable location for message wait- 
ing notification, and user programmable message stor- 
age capabilities. 

[0027] A new system Is provided for broadband ac- 
cess and applications such as multimedia messaging 
service. Unless otherwise Indicated by the appended 
claims, the present Invention is not limited to the pre- 
ferred embodiments described In this section but Is ap- 
plicable to other Integrated multimedia communication 
systems. 
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I. Integrated Communication System Overview 

[0028] Referring to Fig. 1 , an exemplary embodiment 
of a broadband networl< 1 . The broadband networl< gen- 
erally provides interconnection between a plurality of 
customer locations utilizing various interconnection ar- 
chitectures including Internet Protocol (IP) based net- 
work, various existing systems (legacy systems) such 
as the public switched telephone networic (PSTN), ATi\^ 
networks, the Internet, signaling networks, as well as 
other systems. The broadband network provides versa- 
tile Intelligent conduits that may carry, for example, in- 
ternet Protocol (IP) telephony or multimedia signals be- 
tween the customer premises over, for example, the 
public switched telephone network, internet, or wireless 
communication networks. 

[0029] Again referring to Fig. 1 , the broadband net- 
work 1 may Include one or more customer premises 
equipment (CPE) units 102. The customer premise 
equipment 102 may be variously configured. In one ex- 
ample, the customer premise equipment 102 may in- 
clude one or more local control devices such as a broad- 
band residential gateway (BRG) 300. Although the 
broadband residential gateway is preferably disposed 
in a residence for many aspects of the invention, In ex- 
emplary embodiments, It may also be disposed in a 
business or other location. The broadband residential 
gateway 300 may be variously configured to provide one 
or more integrated communication interfaces to other 
devices within the customer premise equipment 102 
such as televisions (TV), personal computers (PC), 
plain old telephone system (POTS) phone(s), video 
phones, IP enabled phones, and other devices. For ex- 
ample, the broadband residential gateway 300 may pro- 
vide one or more telephone port connections (e.g., plain 
old telephone system), Ethernet connections, coaxial 
connections, fiber distributed data interface (FDDi) con- 
nections, wireless local area network (LAN) connec- 
tions, firewire connections, and/or other connections to 
a plurality of devices such as plain old telephones, IP 
based phones, television converters, e.g., cable televi- 
sion (CATV) set top devices, televisions, digital televi- 
sions, high definition televisions (HDTV), video phones, 
and other devices. In exemplary embodiments, the 
broadband residential gateway 300 may support com- 
munications between any of the aforementioned devic- 
es in intra-premises calling and/or extra-premises call- 
ing. Further, when the broadband residential gateway 
300 is used in a business environment, it can function 
as a privatebranch exchange or key type teiephonesys- 
tem. 

[0030] In Fig. 1 , broadband residential gateway 300 

is illustrated as a single physical device. This configura- 
tion is appropriate where centralization of maintenance 
and control is desirable. Alternatively, the broadband 
residential gateway 300 may be separated into more 
than one physical device allowing functionality to be dis- 
tributed to a plurality of different physical locations in the 



6 

customerpremise and/or broadband network 1 . Howev- 
er, in many embodiments, having a centralized broad- 
band residential gateway 300 located in a single location 
provides ease of maintenance, control, and re-configu- 
5 ration as well as a reduction in cost due to shared func- 
tionality. For example, the broadband residential gate- 
way may be configured to provide the intelligence need- 
ed to allow each of the customer premises equipment 
devices to operate within the broadband network 1 . For 
10 example, analog voice may be converted to digital data 
and packetizedfortransmlssion in an appropriate output 
protocol such as an internet protocol (IP). 
[0031] in exemplary embodiments, the broadband 
residential gateway 300 may function to couple devices 
15 within the customer premise equipment 1 02 to the rest 
of the broadband network 1 using any suitable broad- 
band communication mechanism, in the embodiment 
shown in Fig. 1 , the broadband residential gateway 300 
utilizes a hybrid fiber-coaxial plant 112 to couple the 
20 broadband residential gateway 300 to the rest of the 
broadband network 1 . The hybrid fiber-coaxial plant 112 
may be preferred in many embodiments over other 
broadband communication mechanisms because of the 
large number of homes currently connected to cable 
25 networks, the capacity for shared access, and the ability 
for asymmetric data access speeds which allow high 
quantities of data to be distributed to the various devices 
in the customer premises equipment 1 1 2. The hybrid fib- 
er-coaxial plant 112 may include coaxial cable and/or 
30 optical fiber networks in any suitable combination. The 
hybrid fiber-coaxial plant 112 may provide an intelligent 
broadband conduit between the broadband residential 
gateway 300 and a gateway such as the head-end hub 
(HEM) 115. The head-end hub 115 may be variously 
35 configured to provide various services and/or intercon- 
nections with the rest of the broadband network 1 . For 
example, the head-end hub 115 may provide an inter- 
connection point to gather and aggregate external serv- 
ices (e.g., off air and satellite video, public switched tel- 
40 ephone network voice, multimedia messages, and In- 
ternet data) for distribution to and from the hybrid fiber- 
coaxial plant 112. With respect to telephony and multi- 
media calls, the head-end hub 115 may function as in- 
telligent conduit for connection and communication be- 
45 tween the hybrid fiber-coaxial plant 112 and external 
networks such as an IP network 120 and/or an ATM/ 
frame reiay/celi relay network 185. 
[0032] The broadband network 1 may include any 
number of interconnected head-end hubs 115, IP net- 
so works 120, and/or ATM networks 185. Further, the IP 
network 1 20 and/or ATM network 1 85 may be connected 
to one or more other networks and devices such as: 

(1) external networks including a public switched 
55 telephone network (PSTN) 170, an signaling sys- 
tem 7 (SS7) network 1 70, an Internet 1 80, and/or a 
wireless network 144; 

(2) various components including one or more pri- 
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vate branch exchanges 146, terminals 142 includ- 
ing computers and wireless devices, and/or one or 
more stand alone broadband residential gateway 
300; 

(3) one or more administration centers 155; 

(4) one or more secure network management data 
networl<s 190 such as a network operations center 

(NOC); 

(5) one or more billing systems 195 such as OSS; 
and/or 

(6) one or more centralized control centers such as 
what is referred to as an IP central station 200. 

[0033] The IP network 1 20 and/or ATM network 1 85 
may include one or more routers and/or other devices 
to route, for example, telephony calls, multimedia calls, 
signaling messages, administrative messages, pro- 
gramming messages and/or computer data between the 
various devices In the broadband network 1 such as the 
head-end hub 115, the public switched telephone net- 
work 160, the private branch exchange (PBX) 146, as 
well as the other devices discussed above. In preferred 
embodiments, the Information traveling In the iP net- 
work 120 may be packetlzed and formatted in accord- 
ance with one of the internet protocois. The IP network 
1 20 may also Include gateways to interface with the var- 
ious other networks and/or devices. For example, the 
gateways may be distributed at the edge of the IP net- 
work where the IP network interfaces with one of the 
other devices or networks. Alternatively, the gateways 
interfacing the IP central station 200 to, for example, the 
Internet 180, public switched telephone network (PSTN) 
160, signaling system 7 (SS7) 170, wireless networks 
1 44, ATM/frame/cell relay networks 1 85 may be provid- 
ed in the IP central station 200, or in both the IP network 
120 and the IP central station 200, and/or partially dis- 
tributed between the IP network 120 and the IP central 
station 200. Where the gateways are separated by an 
IP network 200, an appropriate transport protocoi may 
be utilized to ioglcally connect the IP central station 200 
to the particular gateway. 

[0034] The IP central statlon(s) 200 may be connect- 
ed to, for example, one or more IP networks 120, ATM 
networks 185, secure management data networks 190, 
and/or administration centers 1 55. The IP central station 
200 may be variously configured to include one or more 
servers and/or one or more gateways. In exemplary em- 
bodiments, the servers and gateways provide the nec- 
essary inteliigence and traffic management capabilities 
to enable information, e.g., IP telephony signals, to trav- 
el through the broadband network 1 . For example, the 
IP central station 200 may be configured to manage 
voice Information transfer from the public switched tel- 
ephone network 160, through the IP network 120, and 
Into and out of one or more devices such as those con- 
nected to a broadband residential gateway 300. The IP 
central station may be configured to store various con- 
trol and system information such as location, address. 



and/or configurations of one or more broadband resi- 
dential gateways 300, as well as other routing and cail 
set-up Information. 

[0035] In exemplary embodiments, one or more ad- 
ministration centers 1 55 may be connected to the I P net- 
work 120 and provide billing and local directory number 
portability administration. The local number portability 
may be handled by one or more Local Service Manage- 
ment System (LSMS) which may be included in the ad- 
ministration center 155 and/or in the IP central station 
200. Further, the Secure Management Data Network 
1 90 may also include a mechanism for transferring var- 
ious information such as billing, call tracking, and/or cus- 
tomer service provisioning. Various existing systems 
may be utilized to provide this information such as ex- 
isting billing systems (OSS) 1 95 and/or one or more net- 
work operations center (NOC). The network operations 
centers may be included in the administration center 
155, the IP central station 200, and/or the billing system 
1 95. The network operations center (NOC) may be var- 
iously configured to Include a translation server to allow 
communications with the various disparate entitles (e. 
g., legacy systems) In the broadband network 1 . 
[0036] The IP network 120 and/or the ATM network 
1 85 illustrated In Fig. 1 may Include one or a plurality of 
sub-networks. Each of the sub-networks may Include Its 
own IP central station 200 in a distributed configuration, 
with certain routing data replicated across all IP central 
stations or each sub-network may be connected to a sin- 
gle centralized IP central station 200. Where the IP net- 
work 1 20 includes one or more sub-networks, each sub- 
network may be connected to multiple head-end hubs 
115. Further, each head-end hub 11 5 may be connected 
to multiple hybrid fiber-coaxial plants 112, and each hy- 
brid fiber-coaxial plant 1 12 may be connected to multiple 
pieces of customer premises equipment 102 and/or 
broadband residential gateways 300. The IP network 
120 provides an interconnected broadband network 
which may be utilized to transport and route packetized 
information to and from diverse geographic locations 
and may be used on a national or internationai basis. 
Further, the iP network 120 and/or ATM network 185 
may utilize private network facilities and/or may be pro- 
visioned over a shared network such as the internet. 
[0037] The IP central station 200 may be configured 
to provide connectivity for the broadband residential 
gateway 300 to the Internet 180 (e.g.. World Wide Web 
(www)), as well as connectivity to other external net- 
works such as public switched telephone network 160 
and signaling system 7 (SS7) 1 70 for end-to-end voice, 
multimedia, and data applications, for example voice 
over IP telephony. IP packets traveling through the IP 
network provide for priority so that, for example, voice 
packets are given priority over data packets to maintain 
certain VoIP telephony QoS requirements and a leased 
line concept for packet traffic which may have an even 
higher priority. However, the system Is sufficiently flexi- 
ble so that the priority can be dynamically altered ac- 
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cording to customer preferences, variable billing rates, 
traffic patterns, and/or congestion. 

A. Internet Protocol Central Station 

[0038] Referring to Fig. 2, tine IP central station 200 
may be variously configured. In preferred embodiments, 
it may be configured to ensure seamless integration of 
IP based communication system including the IP net- 
work 120 with the public switched telephone network 
1 60, signaling system 7 (SS7) network 1 70, and the In- 
ternet 1 80 so that packetized data, for example, voice 
calls and information data, is properly transferred be- 
tween the broadband residential gateway 300, the pub- 
lic switched telephone network 160 and/or the Internet 
180. In one embodiment, the hybrid fiber-coaxial plant 
112, head-end hub 115, and IP network 120, provide a 
virtual signaling conduit for packetized voice and data 
which may, with the coordination of the iP central station 
200, be provided in the appropriate format between the 
broadband residential gateway 300 and the public 
switclied telephone network 160 and/or Internet 180. 
[0039] Again referring nowto Fig. 2, the IP central sta- 
tion 200 may include a central router 200, for example, 
a gigabit switch, which may be utilized to interconnect 
various servers and gateways contained in the IP cen- 
tral station 200. The central router 210 provides for ex- 
ample Ethernet switching and aggregate traffic between 
servers, gateways and the IP network 120 and/or ATM 
network 1 85 backbone. In one exemplary embodiment, 
the central router 210 provides high-speed, non-block- 
ing IP and IP multicast Layer 3 switching and routing. 
The IP central station 200 may include one or more of 
the following servers: the least cost server (LCS) 255, 
the time of day (TOD) server 212, the dynamic host con- 
trol protocoi (DHCP) server, the trivial file transfer pro- 
tocol (TFTP) server, and the domain name service 
(DNS) server 21 4, the system management (SIVI) server 
216, the call manager (CM) server 218, the announce- 
ment server (AS) 220, the multimedia server (IVIS) 222, 
and/or the conference server (CS) 224. As illustrated in 
Fig. 2, the servers may be separate servers, for example 
the call manager server 21 8, or may be incorporated into 
a single server, in the exemplary embodiment, the dy- 
namic host controi protocol server 131 , trivial file trans- 
fer protocol server 132, and the domain name service 
server 21 4 are each incorporated in a single server fa- 
cility. Each server in the IP central station 200 may in- 
clude computer(s), storage device(s), and specialized 
software for implementing particular predefined func- 
tions associated with each server. In this manner, the 
servers in the IP central station may be provisioned as 
a main server and one or more back-up servers to pro- 
vide redundant processing capabiiities. Similarly, the 
router may be implemented as a main router and a back- 
up router with similar routing functionality. 
[0040] The IP central station 200 may also include, for 
example, one or more of the following gateways: a ele- 



ment management gateway (EMG) 238, an accounting 
gateway (AG) 240, an Internet (Boarder) gateway (IG) 
236, a signaling system 7 (SS7)) gateway (SG) 234, a 
voice gateway (VG) 232, and/or a multimedia gateway 
(MG) 230. The IP central station 200 may utiiize one or 
more of these gateways to provide centralized system 
intelligence and control of voice and/or data I P packets. 
[0041] In exemplary embodiments, the dynamic host 
control protocol server and domain name service server 
214 may operate to dynamically assign IP addresses 
devices in the customer premise equipment 1 02. Where 
a dynamic IP assignment scheme is used, the customer 
premises equipment may be provided with one or a plu- 
rality of dynamic IP assignment when activated initially, 
and/or at the initiation of each active secession. Where 
an IP address is assigned when the device is initially 
activated, it may be desirable to assign a single IP ad- 
dress to a single broadband residential gateway and as- 
sign a port address to devices connected to the broad- 
band residentiai gateway 300. In other embodiments, 
an individual IP address may be assigned to each de- 
vice coupled to the broadband residential gateway 300. 
For example, the broadband residential gateway may 
include and/or be coupled to one or more cable mo- 
dems, IP phones, plain old telephone system phones, 
computers, wireless devices, CATV converters, video 
phones, and/or other devices which each may be as- 
signed a unique static and/or dynamic IP address and/ 
or a port of a one of these IP addresses. The particuiar 
protocol for allocating IP addresses and/or ports may be 
specified using protocols defined in the dynamic host 
control protocol server21 4. In exemplary embodiments, 
the dynamic host control protocol and DN server 214 
may be configured to assign available IP addresses 
from address pools based, for example, on the identity 
or type of requesting device, the amount of use expect- 
ed for the requesting device, and/or predefined assign- 
ment protocols defined in the dynamic host control pro- 
tocoi and DN server 21 4. In centralized embodiments, 
it may be desirable to configure the call manager (CM) 
218 to provide sufficient information such that the do- 
main name service server 214 can distinguish between 
static IP devices, dynamic IP devices, registered devic- 
es, unregistered devices, and registered devices that 
have been assigned to a particular class of service e.g., 
data vs. telephony, un-provisioned, vs. provisioned, etc. 
[0042] The trivial file transfer protocol (TFTP) server 
214 may be configured to transfer certain Information 
to/from one or more broadband residential gateways 
300. In exemplary embodiments, the trivial file transfer 
protocol server provides Data Over Cable Service Inter- 
face Specifications (DOCSIS) configuration information 
containing QoS parameters and other information re- 
quired for the broadband residentiai gateway 300 to op- 
erate optimally. 

[0043] Thetime-of-day (TOD) server21 2 may include 
a suitable facility for maintaining a real time clock such 
as an RFC 868-compliant time server. In exemplary em- 
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bodiments, the time-of-day server 21 2 provides system 
messages and/or responses to system inquiries con- 
taining a coordinated time, e.g., universai coordinated 
time (UCT). The universai coordinated time may be 
used by any of tine servers and/or devices in tine broad- 
band networi< 1 . For exampie, tiie broadband residentiai 
gateway 300 may use tine universai coordinated time to 
calculate the local time for time-stamping error logs. 
[0044] The system management (SM) server 216 
may include responsibility for the overall operational 
state and functioning of components the broadband net- 
work 1 , either alone, or In combination with other system 
management servers 216. The system management 
(SM) server 21 6 may be variously configured to provide 
monitoring and administrative functions for devices 
within the broadband network 1 . For example, the sys- 
tem management server 21 6 may be configured to pro- 
vide management of various database functions, mem- 
ory buffer functions, and software utility functions within 
the broadband network 1. Software management in- 
cludes, for example, version control, generic control, 
and/or module control. 

[0045] The least cost server (LCS) 255 may be vari- 
ously configured to enable the system to determine the 
least cost routing of telephone and data transmission 
throughout the network. The least cost server 255 may 
also provide one or more broadband residential gate- 
way users capability to select between, for example, 
cost and Quality of Service (QoS). 
[0046] The announcement service (AS) server 220 
may be variously configured. In exemplary embodi- 
ments, It may store and send announcements to spec- 
ified destinations and/or all destinations based on In- 
structions received by, for example, the call manager 
(CM) server 218. The announcement server 220 re- 
ceives, for example. Media Gateway Control Protocol 
(MGCP) or later signaling (e.g., H.GCP - an ITU stand- 
ard Gateway Control Protocol ) control messages from 
the call manager 21 8, and sends announcements to one 
or more voice gateways (VG) 232 and/or the one or 
more broadband residential gateway 300 (e.g., using 
Real Time Protocol (RTP) packets). The announcement 
server 220 may send an announcement once, a prede- 
termined number of times, or in a continuous loop. The 
announcement server 220 may detect when a phone or 
other device has been taken off-hook and play an ad- 
vertisement or other announcement to the user. Where 
a user has signed-up for an advertising plan whereby 
phone rates are reduced in return for advertising reve- 
nue generated by the advertisements, the announce- 
ment server 220 may be utilized to track the number of 
individuals with a particular Income, age, or other profile 
which hear the advertisement. The announcement serv- 
er 220 may respond to requests from individual system 
devices such as one of the broadband residential gate- 
ways 300 and/or under control of, for example, the call 
manager21 8. Where the announcement server Is under 
control of the call manager 21 8, the call manager may 



be configured to control various operating parameters 
of the announcement server. For example, the call man- 
ager 21 8 may request that certain announcements are 
sent once, a specified number of times, or In a contlnu- 

5 OUS loop. 

[0047] In still further embodiments, announcements 
may be generated elsewhere in the broadband network 
1 , stored as files, and distributed to one or more an- 
nouncement servers via a file transfer protocol or re- 
10 source such as the trivial file server 214 using one or 
more file transfer protocols. In many embodiments, it Is 
desirable to store announcements In an appropriate en- 
coding format (e.g., G.711 or G.729) within the An- 
nouncement Server. The announcement may have an 
15 audio component and/or a audio/video component. The 
audio/video component may be stored using a combi- 
nation of an encoding format (e.g., G.711) and/or a 
standard file forniat such as wave (WAV), MPEG, and 
other suitable formats. 
20 [0048] In one exemplary method of operation, a user 
picks up a telephone which sends a signal to the call 
manager 218. Subsequently, the call manager 21 8 may 
established a connection to the announcement server 
220 and play one or more pre-recorded and/or prede- 
25 termined announcement (hypertext and/or audio). Sig- 
naling tones such as a busy signal may be played by 
the broadband residential gateway 300 or the call man- 
ager 218, but Special Information Tones (SIT) and/or 
messages may also be Included as part of an announce- 
so ment file. In this way, the user experience Is enhanced 
such that the user receives a busy message and/or hy- 
pertext announcement providing one of several options 
for contacting the called party. The announcement serv- 
er 220 may have Information entered by a user using, 
35 for example, a broadband residential gateway to provide 
additional Information to the called party. The additional 
information may include the ability to leave a message, 
type-in a chat note, page the called party, barge-In on 
the call, and/or other user or system defined call han- 
*o dling capabilities. 

[0049] The announcement server 220 may also be 
programmed with various system messages such as an 
announcement indicating that a number dialed is Incor- 
rect orthat the call did not go through as dialed, that the 
45 lines are busy, that all lines between two countries are 
currently busy, that the called party has changed num- 
bers, that the called parties phone has been disconnect- 
ed, that one or more system errors have occurred, and/ 
or other announcement messages. 
50 [0050] The call manager (CM) 21 8 may be variously 
configured. In exemplary embodiments, the call manag- 
er 21 8 provides a centralized call control center for sup- 
porting call set-up and tear-down in the broadband net- 
work 1 . The call manager 21 8 may be configured to In- 
55 dude trunk and line information maintenance, call state 
maintenance for the duration of a call, and/or user serv- 
ice features execution. The call manager 21 8 may also 
provide for call processing functions such as a stand- 
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ardized call model for processing the various voice con- 
nections such as voice over IP calls. In exemplary em- 
bodiments, a standardized "open" call model may be uti- 
lized which supports standardized application program- 
ming interfaces (APIs) to provide transport services and 
other user functions such as calling cards. An open ap- 
plication programming interface and call set-up inter- 
face in the call manager will enable third party applica- 
tions to be loaded into the call manager 21 8 and broad- 
band residential gateway 300. This will facilitate the de- 
velopment of third party applications for enhancing the 
functionality of components in the broadband network 
1 . For example, third parties and other equipment ven- 
dors may manufacture various broadband residential 
gateways 300 for use in the broadband network 1 by 
writing applications to support the open call model of the 
call manager 21 8. The call manager 218 and/or broad- 
band residential gateway 300 may also be configured 
to execute and/or accept commands form a standard- 
ized scripting language which may generate instructions 
for the call manager 218 and/or broadband residential 
gateway 300 to execute various functions. The scripting 
functionality may include the ability to execute an entire 
call model including interfaces to the signaling system 
7 (SS7) 1 70, public switched telephone network 1 60, IP 
network 120, ATM/frame/cell relay network 185, and/or 
other functions within, for example, IP central station 
200 such as the multimedia server 222, announcement 
server 220, system management server 216, confer- 
ence server 224, time of day server 21 2, least cost serv- 
er 255, and/or domain name server 214. 
[0051] The call manager 21 8 may also be configured 
to maintain the call states for each call it handles (e.g., 
a voice over IP call) and respond to system events cre- 
ated by, for example, the multimedia gateway control 
protocol (IVIGCP) messages and/or integrated services 
digital network user part (ISUP) messages for signaling 
system 7 (SS7) protocol that may occur during the 
processing of a call. Exemplary events handled by the 
call manager 21 8 include call state changes, call feature 
changes/call feature triggering events, changes in the 
status of lines and trunks, and/or error conditions. Fur- 
ther, the call manager 218 may interact with devices 
connected to a single circuit on the public switched tel- 
ephone network 1 60 and/or a device connected to a port 
of the broadband residential gateway 300. In this man- 
ner, new devices may be added to the infrastructure and 
operate using the open call model contained In the call 
manager 21 8. 

[0052] The call manager 21 8 may also include stor- 
age for subscriber and network configuration, a cache 
server for faster access to frequently used data, a rout- 
ing engine for selecting an appropriate routing algorithm 
(e.g., least cost routing), and/or a service broker which 
provides the data and logic for specific services. In ad- 
dition, the call manager 21 8 may include an authentica- 
tion (AC) server 245 that provides authentication of var- 
ious devices, objects, packets and users in the integrat- 



ed multimedia system. In this manner, a user may verify 
the identity of the calling or called party. 
[0053] Thecall manager 21 8 may interact with the sig- 
naling gateway (SG) 234, the accounting gateway (AG) 
5 240, the element management gateway (ElVIG) 238, the 
voice gateway (VG) 232, and the multimedia gateway 
(MG) 230 using any suitable protocol such as IP and an 
interconnection mechanism such as the central router 
21 0. In one preferred embodiment, the call manager21 8 
10 may be configured to utilize signaling messages such 
as: a) ISUP messages over Common Object Broker Ar- 
chitecture (COBRA) interface to and/or from signaling 
gateway 234, b) MGCP, SIP - simple internet protocol, 
H.GCP, and/or other suitable control messages to and/ 
15 or from the announcement server 220, c) call event 
records in modified Radius fonnat to the accounting 
gateway 240, d) Radius (or Enhanced Radius or com- 
patible protocol) control messages to and/or from the 
voice gateway 232 and/or the broadband residential 
20 gateways 300, and e) signaling network management 
protocol (SNMP) messages to and/or from the element 
management gateway 238. 

[0054] The call manager 21 8 may incorporate one or 
more databases. For example, the call manager 218 
25 may Include database information such as (1 ) a resourc- 
es database that provides an identification of what re- 
sources are connected to the broadband network 1 and 
their current state; (2) a trunk/gateway database that in- 
dicates which gateway serves what circuits in a trunk; 
30 (3) a customer database which indicates whether a call 
is authorized, identifies what services a line supports 
and determines whether a telephone number is on or off 
the integrated IP communication network; (4) a number- 
ing plan / least cost routing database which provides 
35 routing information that enables the IP central station 
200 to choose the correct trunk as a function of the call 
number; and (5) a local number portability (LNP) data- 
base that indicates the North American Numbering Plan 
(NANP) and associated prefixes which are open for as- 
40 sociation with the number portability service; and (6) an 
address of the service control point (SCP) towards 
which requests for translating these local portability 
numbers should be routed. 

[0055] In exemplary embodiments, the broadband 
45 network 1 includes equipment compatible with the CO- 
BRA standard. COBRA may be utilized to allow appli- 
cations from a plurality of vendors to operate with each 
other. The COBRA standard allows a company, such as 
AT&T, to build its network using multi-vendor equipment 
50 and yet ensure seamless integration and operation. 
Some of the major areas covered by COBRA v. 2.2 in- 
cludes: Inter-ORB Bridge Support, General Inter-ORB 
Protocol (GlOP) support, Internet Inter-ORB Protocol 
(HOP) support, and Environment Specific Inter-ORB 
55 Protocol (ESlOP) support. The call manager 218 may 
integrate these protocols to facilitate call set-up with di- 
verse equipment. This is advantageous in that equip- 
ment from a plurality of vendors may inter-operate over 
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the broadband network 1 without modification. 
[0056] The multimedia server (IVIS) 222 may be vari- 
ously configured. For example, one or more multimedia 
servers may provide support for multimedia messaging 
service and/or the overall management of multimedia 
voice and mail messages transmitted across the broad- 
band network 1 . The multimedia server may be config- 
ured to support e-mail (e.g., html) messages, voice mail 
(audio) messages, and/or video mail (audio and video) 
messages. The multimedia messages may include 
standard pre-configured system messages, advertising 
messages, and/or user defined messages. In either 
event, where the messages are stored in a centralized 
location, the multimedia server may provide such stor- 
age. Where the multimedia server 222 provides storage 
for the multimedia messages, a database may be uti- 
lized for indexing, storage, and retrieval of such mes- 
sages. In exemplary systems, the user may access pre- 
determined ones of these messages. The multimedia 
server 222 may utilize IP as a method of communicating 
with other devices across the broadband network 1 . 
[0057] The conference server (CS) 224 may be con- 
figured to provide for multiparty conference calls using, 
for example, IP voice packets during an IP telephony or 
multimedia session call. The conference server 224 
may Include specialized software that runs on a com- 
puting platform having associated multiplexing and de- 
multiplexing capability for segregating and aggregating 
user information packets. For example, the conference 
server may log several calls into a conference session. 
When information packets are sent from one or more 
phones, they are aggregated and sent to the other 
phones on the conference call. The conference server 
224 may use any suitable communication protocol such 
as H.GCP or SIP. The conference server 224 may func- 
tion to aggregate user information from two or more us- 
ers onto a single call path. The conference server 224 
may include one or more "call-in numbers" and be con- 
trolled from any location, e.g., a centralized operator lo- 
cation and/or one or more broadband residential gate- 
ways 300. It may be desirable to have the conference 
server 224 configured such that some callers simply 
monitor the call without voice interruption while other 
callers have both voice transmit and receive capabili- 
ties, Where a caller is not given the privileges associated 
with active participation in the call, voice packets from 
these users are discarded. For example, a CEO may 
have a conference call with a plurality of financial advi- 
sors and invite the press to listen on the call without In- 
terruption capabilities. 

[0058] The gateways in the IP central station 200 may 
be configured to provide translation of signals to and/or 
from the various servers in the IP central station 200, 
the IP network 120, the public switched telephone net- 
work 160, the signaling system 7 (SS7) network 170, 
the internet 180, and/or the secured management data 
(SMD) network 1 90. The gateways typically support one 
or more of the following group of functions: call process- 



ing; signaling system 7 (SS7) connectivity; billing sup- 
port; OAIVI&P support; connection to public switched tel- 
ephone network; control CoS/QoS parameters; and en- 
hanced services. 

5 [0059] The voice gateway (VG) 232 may be connect- 
ed to the public switched telephone network 160 and 
operate to convert between IP based voice packets and 
standard public switched telephone network 160 voice 
traffic. Voice gateway 232 may be configured as multi- 

10 frequency (MF) or ISUP gateways on a per-TI basis. 
Where multi-frequency (MF) trunks are used, one em- 
bodiment utilizes signaling between the call manager 
218 and the voice gateway 232 using IVIGCP, SIP, H. 
GCP and/or other compatible protocol. Multi-frequency 

'5 trunks may be compatible with Feature Group D (FGD), 
Operator Service (OS) Signaling protocol and/or Termi- 
nation Protocol (TP). 

[0060] The IP central station 200 may be variously 
connected to the public switched telephone network. 
20 For example, the IP central station 200 may be connect- 
ed directly to the public switched telephone network us- 
ing, for example a bearer channel (e.g. , a T1 or T3 car- 
rier) and/or interconnected using one or more networks 
such as an IP network and/or ATM/frame/cell relay net- 
25 work 185. Where a T1 network is utilized, it may be de- 
sirable to utilize one or more of ISUP or MF, FGD, and 
OS to interconnect a service bureau in the public 
switched telephone network 1 60. Alternatively, the serv- 
ice bureau in the public switched telephone network 1 60 
30 may be interconnected using an alternative network ar- 
rangement such as an IP network 120 and/or a ATM/ 
frame/cell relay network 185. The service bureau may 
coordinate with the IP central station 200 in providing 
operator services, directory services and provisioning 
35 for311,611,and711 services. Emergency 911 services 
may be routed to an E911 tandem switch that has the 
appropriate databases and interfaces with a Public 
Safety Answering Position (PSAP). Emergency 911 
services may be coordinated by the call manager 218 
40 and/or public switched telephone network based service 
bureau. 

[0061] Voice gateway 232 may be router-based and 
include one or more voice feature cards and/or DSP 
Module cards to perform voice processing. The voice 
45 gateway 232 may optionally include host processors, 
LAN/WAN ports, Ethernet ports, T1 or El telephony in- 
terface cards. Voice Feature Cards with DSP Modules 
providing voice compression transcoding (G.711 and G. 
729), carrier-quality echo cancellation with 8 ms-32 ms 
50 tail length, a de-jitter buffer which adapts to delay vari- 
ations in the network in order to minimize the delay, 
packet loss concealment that generates concealment 
frames for lost packets using information from previous- 
ly received data, and/or tone detection and generation. 
55 This function detects Multi-Frequency (MF) tones and 
generates MF and call processing tones (e.g. dial tone, 
call-waiting tone etc.). 

[0062] In exemplary embodiments, the voice gateway 
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232 may include T1/E1 interfaces with internal Channel 
Service Units (CSUs). It may also be desirable to con- 
figure the voice gateway 232 such that ISUP, MF and 
Centralized Attendant Services (CAS) trunl<s are sup- 
ported with a configuration done on a per T1 basis. Ad- 
ditionally, multi-frequency tones and Centralized At- 
tendant Services may utilize a "robbed bits" communi- 
cation scheme where bits are "robbed" from sub-frames 
to transmit in-band signaling. The multi-frequency tones 
may be converted to and/or from, for example, simple 
gateway control protocol (SGCP) signal requests and 
events by the voice gateway 232. For example, multi- 
frequency tones and/or lower level signaling and timing 
functions may be translated to and/or from any of the 
following indications: simple gateway control protocol 
Notify functions, simple gateway control protocol Notifi- 
cation Requests, Connection requests. Modify Connec- 
tion requests, off-hook and/or on-hook indications. 
[0063] An Ethernet interface with a RJ-45 connector 
may be used to connect the voice gateway 232 to the 
central router 210 (e.g.. Gigabit Switch or High Speed 
Router (HSR)). The multimedia gateway control proto- 
col may be used as the interface between the voice 
gateway 232 and the call manager 218. For example, 
call control, signaling, and multimedia data stream, real 
time protocol (RTP) connections, IP addresses, UDP 
ports, codec choice etc, may be configured in any suit- 
able manner such as by using a multimedia gateway 
control protocol. In exemplary embodiments, audio 
streams may be passed directly between customer 
premises equipment 102 using real time protocol con- 
nections over, for example, a user datagram protocol 
(UDP). Thus, the multimedia gateway control protocol 
may be utilized to request the voice gateway 232 to in- 
itiate, cancel, and/or otherwise modify connections in or- 
der to set up and tear down RTP media streams. A sim- 
ilar procedure may also be utilized to request continuity 
tests and results. 

[0064] In exemplary embodiments, it may be desira- 
ble to adapt the IP network to carry signaling system 7 
(SS7) Transaction Capabilities Application Part (TCAP) 
messages over the IP network 120 and/or the ATIVI/ 
frame/cell relay network 1 85. The transport of signaling 
system 7 (SS7) transaction capabilities application part 
(TCAP) messages over the packet networks allows sig- 
naling operations to be supported by multiple connec- 
tions to the same host, multiple host connections, and 
distributed processing of call set-up information using, 
for example, multiple call managers 218 in the broad- 
band network 1 . Thus, the IP network 120 and/or ATM/ 
frame/cell relay network may be utilized to interconnect 
a plurality of ESS switches to transport signaling infor- 
mation, voice, and/or data. In embodiments where the 
signaling gateway (SG) 234 is configured to support sig- 
naling system 7 (SS7) signaling transport using trans- 
action capabilities application part (TCAP) messages, it 
may be desirable to include a translator for converting 
between multimedia gateway control protocol (MGCP) 



messages and transaction capabilities application part 
(TCAP) messages and/or ISDN User Part (ISUP) mes- 
sages. 

[0065] The point where ISUP and TCAP messages 
5 are terminated at a signaling system 7 (SS7) signaling 
gateway is defined as a Service Switching Point (SSP) 
to the signaling system 7 (SS7) network 170. The call 
manager 218 may be configured with a standardized 
Application Programming Interface (API) to allow inter- 
10 action with the signaling system 7 (SS7) by, for example, 
sending and/or receiving ISUP and TCAP messages 
from a service switching point (SSP). Full class 5 sign- 
aling system 7 (SS7) functionality may be included in 
the call manager 21 8 including the ability to provide all 
15 of the infonnation necessary for billing as defined in the 
GR-246-Bellcore standard. The signaling gateway 234 
may be arranged to perform: signaling system 7 (SS7) 
message handling (message discrimination, message 
distribution, and message routing); signaling link man- 
20 agement (e.g., link activation, deactivation); signaling 
route management (managing Point Code [PC] route 
status based on route received management messages 
such as Transfer Prohibited, Transfer Allowed, Transfer 
Restricted, etc.); and signaling traffic management (di- 
ss version of traffic based on unavailability, availability, re- 
striction of signaling link, route, and Point Code.) The 
signaling system 7 (SS7) architecture supports the nec- 
essary redundancy component scheme for system reli- 
ability and availability during scheduled maintenance 
30 and/or software/hardware upgrades. The signaling 
gateway 234 may be configured to directly provide for 
lower level signaling system 7 (887) processing. 
[0066] In exemplary embodiments, the signaling 
gateway 234 interacts with the call manager 21 8 using 
35 an appropriate open interface (e.g.. Common Object 
Request Broker Architecture (COBRA)). In these em- 
bodiments, it may be desirable for translation software 
in the signaling gateway 234 to add Message Transfer 
Part (MTP) layer information to the ISUP and/or TCAP 
■to data to create a complete signaling system 7 (SS7) mes- 
sage. The complete signaling system 7 message may 
then be sent to the Signaling Transfer Point (STP) in the 
external signaling system 7 (SS7) network 170. Con- 
versely, the signaling gateway 234 may be configured 
45 to remove ISUP orTCAP application layer data from the 
signaling system 7 (SS7) messages received from the 
STP priorto converting the information to an appropriate 
open interface (e.g., COBRA) and forwarding the infor- 
mation to the call manager 218 via the central router 
50 210. 

[0067] The accounting gateway (AG) 240 may be 
configured to receive messages representing events 
from the call manager 21 8 via a suitable transport mech- 
anism such as the central router 21 0. Typically, two mes- 
55 sages are received for each call, the first when the call 
is established, and second when the call terminates. In 
the case of unsuccessful calls, only the failure message 
will be logged. The messages provide details about the 
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calling and called parties, the timing of the call set-up, 
the duration and the quality of the call. Accounting gate- 
way 240 may be duplicated using a redundant compu- 
ter, with each gateway having dual-mirrored disks. The 
accounting gateway 240 stores usage records and may 
then distribute them to linked destinations (e.g., billing 
centers) for processing. Billing centers typically include 
bill processors that receive accounting information from 
the accounting gateway 240 and generate appropriate 
on-line or paper billing to customers. The accounting 
gateway may be configured to accommodate multiple 
days worth of accounting records such as the records 
for one day, two days, three days, four days, a week, or 
a month. The period in which the data is retained In the 
accounting gateway may be dependent on business 
needs, hardware restrictions, and/or the billing cycle. 
For example, as the end of the billing cycle nears, It may 
be desirable to shorten the period the accounting gate- 
way holds the data such that calls placed the day the 
bills are printed are included on the bills. Further, the 
accounting gateway may both retain and fonward data 
to the billing centers. In this manner, if the equipment at 
the billing centerfails, the accounting gateway 240 may 
serve as a backup. Similarly, the billing center may act 
as a backup where the accounting gateway 240 fails. 
[0068] An Automatic Message Accounting (AIVIA) for- 
mat Is typically used by circuit-switching systems, pack- 
et-switching systems, and other network elements to 
provide billing usage measurements data (e.g. , the Bell- 
core® Automatic Message Accounting Format (BAF)). 
This data may be utilized either to permit charging the 
customer for use of network resources or to permit 
charging other carriers (e.g., Inter-Exchange Carrier 
(I EC) and other Local Exchange Carrier (LEC)) for as- 
sistance in placing call connections. The accounting 
gateway 240 may be configured to convert this Informa- 
tion into an Automatic IViessage Accounting Format 
(AMA) Format (e.g., BAF) records and send these 
records to the external billing systems using, for exam- 
ple, a TFTP (trivial file transfer protocol). Time-stamp 
accuracy is typically based on the accuracy of the call 
manager 21 8 clock which may be derived from the TOD 
212 server. To create appropriate AIVIA records, the 
event information produced by the call manager 218 
preferably has appropriate information forthe telephone 
service specified such as phone number of the calling 
party (customer), phone number of the called party (cus- 
tomer), time of call, duration of the phone call, and use 
of any discretionary features. Different AMA structures 
may be generated between On-Net calls (defined as 
within a network service provider IP network 120) vs. 
Off-Net calls (defined as outside of service provider IP 
network - e.g. public switched telephone network) for 
billing purposes. 

[0069] The element management gateway (EMG) 
238 may provide system management functionality that 
Includes, for example: a) status and performance mon- 
itoring for the Operation Administration, Maintenance, 



and Provisioning center, to gauge the ongoing operation 
of applications; b) extensive information exchange with 
a network operations center responsible for ongoing 
maintenance of one or more applications; c) customlz- 
5 able operations interface to allow the network opera- 
tions center to view only information required, thus re- 
ducing the time spent filtering information; d) centralize 
distributed application configuration allowing for the 
centralized configuration of objects residing on a plural- 
10 ity machines; e) proactive network management capa- 
bilities to remove the need for constant operator Inter- 
vention making the day-to-day operations more effi- 
cient; and/or f) Intelligent display of status Information 
to separate critical Issues from low-priority problems al- 
15 lowing the operation center to assign resources to the 
right problems at the right time. 
[0070] The multimedia gateway (MG) 230 may be 
configured to connect to the public switched telephone 
network 160 and to convert IP based multimedia pack- 
20 ets into standard public switchedtelephone network 1 60 
traffic. The multimedia gateway 230 may include an in- 
telligent trunking interface that communicates with the 
call manager 21 8 for automatic trunk sizing and alloca- 
tion between the I P network 1 20 and the public switched 
25 telephone network 160. For example, when an system 
user at the customer premises Is using a PC and/or a 
multimedia phone to communicate with a traditional 
public switched telephone network 160 user, the com- 
munication session Involves the transmission of video 
30 and audio data. The bandwidth that is required for this 
type of communication Is much greater than that re- 
quired for a PSTN-to-PSTN voice call or an IP-to-PSTN 
voice call. The multimedia gateway 230, as the Interface 
between two systems, may negotiate a larger bandwidth 
35 to facilitate the call If the called party Is also video ena- 
bled. This bandwidth negotiation process typically oc- 
curs with a SESS or a Local Digital Switch within the 
public switched telephone network 1 60. Typically, a mul- 
timedia call, including live video, audio and data, will re- 
40 quire bandwidth ranging from 56K to 1 .544 Mbps. How- 
ever, as the number of users sharing the same link 
grows, the quality of the transmission deteriorates sig- 
nificantly. The multimedia gateway 230 must be able to 
monitor bandwidth usage and make appropriate adjust- 
45 mentsso as to maintain an acceptable quality of service. 
Further, It may be desirable for the call manager 21 8 
and the multimedia gateway 230 to communicate be- 
tween themselves and/or the customer premises equip- 
ment 1 02 to determine whether the user has authorized 
50 the additional bandwidth and hence expense of the call. 
For example, even where a called and/or calling party 
Is video enabled, It may nonetheless refuse to authorize 
payment for the increased bandwidth necessary for vid- 
eo. 

55 [0071] The Internet gateway (IG) 236 may be con- 
nected to the Internet (e.g., WoNd Wide Web (www)) and 
provide a means for IP based data packets to be routed 
between the IP network 120 and the Internet 180. Alter- 
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natively, IP based voice packets may be routed via the 
Internet 180. In exemplary embodiments, the Internet 
gateway 236 routes data-only packets which share the 
same priority level with other lower priority, non-real- 
time traffic consistent with computer data communica- 
tions presently experienced with the Internet 1 80. Con- 
sequently, low priority and low latency data traffic on the 
IP network 120 utilize the Internet gateway 236 to com- 
municate with other IP data networks such as the www. 
Voice packets may be routed through another network 
such as the ATM/frame/cell relay network 1 85, a private 
IP network 120, and/or the public switched telephone 
network 1 60 where committed Information rates may be 
easily obtained. 

[0072] In exemplary embodiments, the broadband 
network 1 Includes the Interfaces which enable connec- 
tions to existing Operation, Maintenance and Provision- 
ing (OAlVi&P) 1 95 systems that support, billing, account- 
ing, provisioning and/or configuration management 
functions. A Secured Management Data (SIVID) Net- 
work 1 90 may be utilized to connect the OAM&P 1 95 to 
the accounting gateway 240 and element management 
gateway 238, The Secure Management Data network 
1 90 may include a Network Service Division's NSD Net. 
The Secure Management Data network 190 helps en- 
sure that only secure communication can occur be- 
tween the IP central station 200 and the OAM&P 195. 
This eliminates one potential means of tampering with 
the billing and provisioning functions in the OAM&P. The 
billing systems (OSS) 1 95 may Include the Network Op- 
erations Center (NOC). The NOC may Include a trans- 
lation server which Includes functions for allowing com- 
munications and control of diverse networks. 

B. Broadband Residential Gateway (BRG) 

[0073] Referring to Fig. 3, a preferred embodimentfor 
a broadband residential gateway (BRG) 300 will now be 
described and explained. The broadband residential 
gateway 300 may be configured as the Interface unit be- 
tween the remainder of the customer premise equip- 
ment 1 02 devices and the external network. The broad- 
band residential gateway 300 may be connected to the 
remainder of the broadband network 1 using any suita- 
ble mechanism such as a gateway directly into an IP 
network and/or a cable connection. In the most pre- 
ferred embodiments, a hybrid fiber-coaxial plant con- 
nection is utilized such as hybrid fiber-coaxlal (HFC) 
plant 112. The hybrid fiber-coaxial plant 112 allows nu- 
merous broadband residential gateways 300 to be In- 
cluded on an existing hybrid fiber-coaxlal plant 1 1 2 with- 
out modification to the plants Infrastructure. 
[0074] The broadband residential gateway 300 may 
be variously configured to, for example, provide high- 
speed cable modem capabilities to interconnect one or 
more associated PCs with each other and with the re- 
mainder of the broadband network 1 , provide function- 
ality to one or more TVs (using, for example, either an 



integrated or separate decoder functionality, e.g., set 
top box 350), one or more telephone connections such 
as plain old telephone service (POTS) phones and/or 
digital telephones, displays, wireless interfaces, voice 
5 processing, remote control interface, display interface, 
and/or administrative functions. In exemplary embodi- 
ments, the broadband residential gateway 300 may a) 
providing conversion between analog voice and I P voice 
packets, b) multiplexing/demultiplexing streams of IP 
10 voice packets, c) supporting multiplexing/demultiplex- 
ing of multiple incoming and outgoing signals including 
multiple voice, multimedia, data, system administration, 
and/or TV Information signals. 
[0075] Where the elements of the broadband residen- 
ts tial gateway 300 are Interconnected, the Interconnection 
may be provided by one or more data buses, for exam- 
ple, a high speed bus (HSB) 360, processor bus 380, 
and/or other Interconnection system. The high speed 
bus 360, 380 may be configured to provide a flexible 
20 conduit for transferring information between the internal 
hardware, processors and ports. In exemplary embodi- 
ments of the broadband residential gateway 300, the 
high speed bus 360 may include one or more of the fol- 
lowing functional units a) a universal remote control re- 
25 celver module 365 for receiving wireless (e.g., infrared, 
and/or RF) signals (e.g., keyboard signals and/or re- 
mote control signals) for control of the broadband resi- 
dential gateway 300 and/or any connected devices, b) 
a display, display driver, touch screen logic module for 
30 driving one or more local and/or remote displays for in- 
terfacing with the broadband residential gateway 300 
and/or one or more connected devices, c) one or more 
TV port modules 336 for Interconnecting televisions, 
set-top devices, and/or other audiovisual devices to the 
35 broadband residential gateway 300, d) one or more data 
port modules 334 for connecting/Interconnecting data 
enabled devices (e.g., personal computers, palm top 
devices, etc.), e) one or more telephony port modules 
332 for interconnecting one or more analog and/or dig- 
40 ital telephones, f) one or more peripheral port modules 
342 for interconnecting one or more peripheral devices 
such as disk drives, data storage devices, video cas- 
sette recorders, DVD devices, audio devices, video de- 
vices (e.g., camcorders, digital cameras, digital video 
45 recorders, stereos, etc.), g) one or more external/inter- 
nal Intercom modules 344 for interconnecting remote in- 
tercom and/or security monitoring devices, h) one or 
more wireless Interface modules 345 for Interconnecting 
with various wireless extension devices such as wire- 
so less TVs, cordless and/or wireless telephones, wireless 
LANs, etc.) one or more voice recognltlon/volce synthe- 
sis modules 355 for generating voice announcements, 
voice messages, and voice prompts and for recognizing 
voice generated commands and data, j) set-top box 
55 module 350 for performing the functions associated with 
a set-top box locally and/or for communicating with one 
or more remotely coupled set-top boxes, k) memory 322 
(e.g., DRAM, RAM, flash, and/or other memory) for stor- 
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ing information and operating data witliin the broadband 
residential gateway 300,1) transceiver 302 for commu- 
nicating with one or more externai broadband networks 
m) operating program store 330 (e.g., ROM, fiash, etc.) 
for storing at ieast portions of the operating programs 
for the broadband residentiai gateway 300 and/or inter- 
connected devices, n) security processor, smart card 
and/or credit card interface module 340 for providing se- 
cure processing functions and/or credit card/smart card 
transaction functions, and/or o) distributed processing 
controller 306 which may be a microprocessor and/or 
one or more Interconnected distributed processing mod- 
ules for controlling the broadband residential gateway 
300. Where the distributed processing controller 306 In- 
cludes one or more distributed processing modules, the 
modules may include a telephony processing module 
(P1) 308, data processing module (P23) 310, video 
processing module (P3) 312, auxiliary processing mod- 
ule (P4) 314, IP processing module (P5) 31 6, and/or an 
operations administration maintenance and provision- 
ing processing module (P6) 31 8 Interconnected through 
one or more busses such as processor bus 380. The 
processor bus 380 and/or high speed bus 360 may in- 
clude any suitable interconnect bus including intelligent 
bus configurations incorporating smart buffer logic (not 
shown in Fig. 3) to facilitate data transfer between inter- 
connected processors and/or modules. The various 
modules and/or processing components of the broad- 
band residential gateway 300 may be powered by, for 
example, a power supply unit (not shown). Each of the 
Individual modules of the broadband residential gate- 
way will now be described In more detail. 
[0076] The transceiver 302 may Include circuits for 
converting digital signals to and from RF signals suitable 
for transmission across a broadband network such as 
the hybrid fiber-coaxial plant 112. The transceiver 302 
may Include one or more input/output ports such as a 
cable interface (e.g., an F connector cable connection) 
and/or a fiber optic interface connected to a communi- 
cation media (e.g., hybrid fiber-coaxial Plant 112). The 
transceiver302may be compatible with the DOCSIS 1.0 
or later specifications. For signaling purposes, the 
broadband residentiai gateway 300 may be compatible 
with the iVledia Gateway Control Protocol (iVIGCP) or 
other compatible signaling protocol (e.g., SIP orH.GCP) 
to support telephony applications. The transceiver 302 
may serve as a modem, a translator and/or a multiplex- 
er/demultiplexer. Data received from the network may 
be de-multipiexed and placed on the data bus for dis- 
patch to the appropriate peripherals and/or ports. Data 
from the various ports and peripherals may be multi- 
plexed together for distribution over one or more broad- 
band networks (e.g., the hybrid fiber-coaxial (HFC) plant 
112). Where a hybrid fiber-coaxial plant 112 is utilized, 
the data may be multiplexed onto various frequency 
bands of the hybrid fiber-coaxial plant 112 In a continu- 
ous data stream(s) and/or packetlzed data stream(s). 
To facilitate data transferfor various networks, the trans- 



ceiver 302 may be include one or more registers for data 
queuing and/or IP tunneling of data packets across the 
broadband network. 

[0077] Although the illustration of a display, display 
5 drivers, and touch screen logic device 338 suggests that 
the a display is integral to the broadband residentiai 
gateway 300, alternative embodiments of the broad- 
band residential gateway 300 may provide a user inter- 
face via the TV screen, PC screen, video telephone, 
10 and/or other display device In addition to, or in lieu of, a 
display integral to the broadband residentiai gateway 
300. 

[0078] The peripheral ports module 342 may Include 
a plurality of ports providing connectivity to external pe- 

15 ripherals. Exemplary Interfaces Include, PCI, Firewire, 
USB, DB25, etc. Devices which Incorporate one or more 
of these Interfaces may utilize the broadband residential 
gateway 300 to Interconnect to the remainder of the 
broadband network 1 . 

20 [0079] The external/internal intercom iVIoduie (IM) 
344 may include one or more microphones/speakers, 
voice CODECS, telephony processors, and/or interface 
ports. Where an intercom module 344 is utilized, the 
built-in circuitry may be configured to detect, for exam- 

25 pie, unused plain old telephone system telephone(s) 
and generates a special intercom tone on these unused 
telephones. In this manner, existing plain old telephone 
system telephones, digital phones, and/or other devices 
may serve as an Intercom throughout the residence. 

30 The controller 306 (e.g., such as the PI telephony proc- 
essor 308) may function to command the Intercom mod- 
ule 344 to determine an appropriate intercom path to 
select an Intercom connection between various loca- 
tions. In exemplary embodiments, the CODEC may be 

35 configured to convert the analog voice signal Into IP 
packets for transmission over one or more data ports 
334, TV ports 336, display modules 338, telephony ports 
332, peripheral ports 342, external/Internal Intercom 
ports 344, wireless Interface ports 345, and/or set-top 

40 boxes 350. 

[0080] In yet further embodiments, multiple broad- 
band residentiai gateways 300 may be configured 
through, for example, IP tunneling, to set-up an intercom 
connection between multiple remote broadband resi- 

45 dential gateways 300. In this manner, an administrative 
assistant at the office may be contacted via an intercom 
connection present at the users home. Thus, one or 
more Individuals disposed at either local and/or remote 
locations with diverse types of equipment may commu- 

50 nicate as an Intercom group without the need to com- 
municate via normal dialing procedures. 
[0081] In addition to Intercom services, the Intercom 
module 344 may also configure Intercom services for 
other telephony services (e.g., extension transfer, call 

55 conferencing, Internal caller ID), high speed data serv- 
ices (e.g., LAN connections), facsimile transmission/re- 
ception, e-mail transmission/reception, video confer- 
encing, and/or CATV/HDTV (Cable Televlslon/HIgh Def- 
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inition Television) using standard industry protocols 
such as DOCSIS 1 .0 or higher and IP tunneling trans- 
missions. These services are advantageous in that once 
configured, the user may simulate a work environment 

in his home. 

[0082] Though processing may be accomplished by 
a single processor performing all functions (e.g., 
processing controller 306), in the preferred embodiment 
shown in Fig. 3, the architecture employs a distributed 
processing controller 306, and a plurality of processors 
P1-P6 308-318. In the distributed processing architec- 
ture, each of the plurality of processors P1-P6 may be 
configured to have a dedicated function to provide pre- 
determined services or applications. The processors 
may be coupled together via any suitable mechanism 
such as the processor bus 380 and/or high speed bus 
(HSB) 360. The first processor P1 308 may include te- 
lephony applications such as call set-up, call tear down, 
and call functions; the second processor P2 310 may 
include management functions such as distribution and 
coordination of data within the various devices of the 
broadband residential gateway 300; the third processor 
P3 312 may include video processing functions for con- 
figuring control panels, screen displays of attached de- 
vices, video conference calls, MPEG decoding func- 
tions and other video processing functions; the fourth 
processor P4 314 may include an auxiliary processor 
for off loading special processing functions such as nu- 
meric processing; the fifth processor P5 316 may in- 
clude interface input/output processing (e.g., text to 
voice and vise versa) and/or Internet protocol (IP) 
processing functions for configuring data to communi- 
cate with the remainder of the broadband network 1 and/ 
or devices attached to the broadband residential gate- 
way 300 such as IP telephones or IP enable PCs; and 
the sixth processor P6 318 may include processing 
functions for Operation, Maintenance and Provisioning 
(OAIVI&P) processing. Each of the above processors 
may be an entirely separate processing unit with includ- 
ed RAM, ROM, Flash memory, or may share RAM, 
ROM, and/or Flash memory. Whereshared RAM, ROM, 
and/or Flash memory is utilized, the memory may be lo- 
cated within the distributed processor controller 306 
and/or on the processor bus 380. Alternatively, the 
memory may be integrated into the operating program 
store 330 and/or into memory 322. 
[0083] The Distributed Processing Controller306 with 
Its associated processors (P1-P6) may be coupled to 
the various elements of the broadband residential gate- 
way 300 so as to enable proper operation of each of the 
individual components. For example, the distributed 
processing controller 306 (with any associated proces- 
sors (PI -P6)) may also coupled to the security proces- 
sor, smart card / credit card, and interface module 340, 
the peripheral port(s) module 342, and/or the External/ 
internal Intercom Module 344 for providing control and 
coordination among devices coupled to the high speed 
bus 360. 
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[0084] The display 338 may include, for example, an 
interactive LED/LCD module positioned in a suitable lo- 
cation such as within or attached to the broadband res- 
idential gateway 300. The display 338 may include an 
Interface to notify, display and receive user inputs and 
processing status. The display 338 may be configured 
to display various informational status such as multime- 
dia mail, called ID, call logs, call in progress and asso- 
ciated information, call waiting infomiation, call confer- 
encing, and/orothercall related information. The display 
338 may provide a display of real time status of the var- 
ious devices connected to the broadband residential 
gateway 300 as well as any current connections, calls, 
and/or data transfers. The display 338 may also include 
touch screen capabilities that allow information to be in- 
put via a plurality of Interrelated on-screen prompts, on- 
screen icons, and/or a keypad (e.g., an alphanumeric 
keyboard). The keypad may be a remote control, numer- 
ic keyboard, and/or alphanumeric keyboard. 
[0085] In one embodiment of the display 338 opera- 
tion, a user may touch an icon representing a pending 
voicemail and/or multimedia mail message. The panel 
may be configured to send an electronic signal to the 
processing controller 306 and/or an attached processor 
such as the telephony processor. On receiving the sig- 
nal, the P1 telephony processor 308 may be configured 
to generate an IP packet via the transceiver 302 across 
portions of the broadband network 1 to the multimedia 
server 222 in IP central station 200. The multimedia 
server 222 may authenticate the request by, for exam- 
ple, verifying location of the request and/or the Identity 
of the requesting party. Where identity of the calling par- 
ty Is being verified, the user enter an access password 
by an audio and/or keyboard request. Where an audio 
request is generated, the user may utilize the external / 
internal intercom module 344 of the broadband residen- 
tial gateway 300, or via a text message entered into the 
display 338. The user may then enter the appropriate 
access code via the onscreen soft keypad, microphone, 
and/or keyboard. Alternatively, the message could be 
stored locally in the broadband residential gateways 300 
memory 322 and depending on whether there is a pass- 
word lock on the broadband residential gateway 300, 
the user may not have to enter a password to access 
the message. Where the message is stored locally in 
the broadband residential gateways 300 memory 322 
rather than IP central station, the display 338 simply re- 
calls the message from memory and presents to the us- 
er to provide one-touch instant message retrieval. 
[0086] In embodiments where the broadband resi- 
dential gateway 300 supports multiple mailboxes, the 
icons on the LCD/LED may be personalized to show the 
identity of the owner of the message. Each user may 
have a different password to ensure privacy of access. 
An activity log which tracks past and present messages 
and/or archives multimedia messages may be present- 
ed on display 338. The archive may be stored locally, or 
at a remote location such as I P central. The archive may 
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be utilized by the user to recail messages whicii have 
long since been erased from local storage but may be 
retrieved from IP central on tape and/or disl< storage. 
This is preferably an optional feature for those users 
who are less security conscious. The multimedia mes- 5 
sages need not be displayed only on display 338. In al- 
ternate embodiments, any of the peripheral devices at- 
tached to the broadband residential gateway 300 are ca- 
pable of receiving the multimedia messages. 
[0087] The memory 322 may be variously configured io 
to include one or more fleid-upgradeabie card slots for 
permitting memory expansion. Certain users may wish 
to enable higher end applications such as near video on 
demand (e.g., pausing of shows via buffering in memo- 
ry), video conferencing of multiple users, multi-party 
conferences, call waiting for multiple parties, etc. Ac- 
cordingly, the use of a broadband residential gateway 
300 allows the userto upgrade memory via inserting ad- 
ditional cards. Alternatively, the user may use system 
memory in IP central and buffer data remotely. so 
[0088] Operating program store 330 may be config- 
ured to receive updates. This may be accomplished by 
having the user replace one or more memory cards or 
automatically by the IP central station downloading new 
operating code into one or more residential gateways 25 
300. 

[0089] As previously indicated, smart buffer logic 
(SBL) may be coupled to the telephony port(s) 332, data 
port(s) 334, TV port(s) 336, peripheral port(s) 342, and/ 
or the distributed processing controller (DPC) 306. so 
Where the smart buffer logic is utilized, it may function 
to buffer the IP packets for delivery over the communi- 
cation networl< such as the hybrid fiber-coaxial plant 
112. In addition, the smart buffer logic may include se- 
lectable switching and routing algorithms based on serv- 35 
ices and applications associated with each port. De- 
pending on the destination of the IP traffic, the smart 
buffer logic may multiplex signal from various devices 
to effect faster information transfer The smart b uff er log- 
ic may also allow direct memory access between mem- *o 
ory 322 and one or more of the devices and/or ports cou- 
pled to the high speed bus 360. 
[0090] The telephony port(s) 332 may include various 
interface circuitry (e.g., analog interface, logic and 
firmware for interfacing with the Plain Old Telephone 45 
(POTs) telephones). Also the telephony port(s) 332 may 
also be configured to include user interface logic, voice 
processing logic, voice activity detector logic, voice CO- 
DECS, and DTMF (dual tone multi-frequency) tone 
sensing logic. Echo cancellation and automatic gain so 
control may also be utilized in the telephony port(s) 332 
circuitry, in one embodiment, RJ-11 connectors for a 
plurality of lines (e.g., 4) are provided for connection to 
one or more existing plain old telephone system 110 tel- 
ephone units. However, the broadband residential gate- 55 
way 300 may contain any number of telephone connec- 
tion ports, in this manner, any number of existing user 
phone may connected directly to the broadband resi- 
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dential gateway 300 without modification. Alternatively, 
the broadband residential gateway can be configured to 
support, in addition to or as alternative to the plain old 
telephone system telephone units, ISDN telephones 
and/or other digital phones (e.g., IP telephones) using 
an appropriate interface. 

[0091] The data port(s) 334 interface may be various- 
ly configured. In one configuration, the data ports in- 
clude high speed data service connections to, for exam- 
ple, a personal computer (PC) using a LAN connection. 
For example, the data ports 334 may include an Ether- 
net 802.3 connection compatible with category 5 un- 
shielded twisted pair (DTP) cable and a RJ-45 connec- 
tor. The data port(s) 334 may include the necessary in- 
terface circuitry for coupling to remote computers. 
[0092] The TV port(s) 336 may include an interface 
for conventional television, HDTV and/or CATV servic- 
es. The TV port(s) 336 typically have one or more F- 
connectors used for coaxial cable connection to a TV 
set(s). The TV ports may be configured to connect to a 
set top box (STB) via the F-connector or directly to a 
remote television. In embodiments where the set top 
box is co-located with the television, the data supplied 
over the TV ports may be either analog and/or digital 
information. Where the set top box is integrated into and/ 
or comprises the broadband residential gateway 300, 
the TV ports may be analog or compatible with HDTV 
signals. 

[0093] The broadband residential gateway 300 need 
not necessarily be limited to home use and is intended 
to also be utilized in business applications, in some con- 
figurations, the broadband residential gateway 300 may 
serve the same functions and operate as a private 
branch exchange (PBX). Where greater capacity is de- 
sired, one or more broadband residential gateways 300 
may be disposed on a PC card and combined in a PC, 
racl<-mount, and/or server to create an expandable pri- 
vate branch exchange type system that enables intra- 
premises calling between telephones connected to var- 
ious telephone connectors on the broadband residential 
gateway 300. 

0. Integrated Broadband IP Based Communication 
System 

[0094] Fig. 4 shows an exemplary embodiment of the 
broadband networl< 1 shown in Figs. 1-3, with iil<e com- 
ponents identified with identical numbers. At the extrem- 
ities of the integrated communications system is the 
customer premises equipment unit (CPE) 1 02, e.g., one 
or more customer premise equipment 1 02 at each cus- 
tomer location. The customer premise equipment 102 
may be configured to include an integrated communica- 
tion interface device such as the broadband residential 
gateway 300. Other customer premise equipment 102 
devices such as one or more televisions (TV) 1 06, per- 
sonal computers (PC) 108, and telephones 110, etc., 
may be connected to the broadband residential gateway 
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300 via various ports as discussed above. Tiie customer 
premise equipment 1 02 could include multiple TVs 1 06, 
teleptiones 110, and PCs 1 08 connected to a single and/ 
or multiple broadband resldentiai gateway 300. Furtlier, 
in certain embodiments, it may be desirable to divide ttie 
broadband residential gateway 300 into more than one 
physical pacl<age. In this manner, certain interface cir- 
cuitry may be located outside of the home while various 
processing circuitry may be located near a peripheral 
device such as in a set top. 

[0095] Where the broadband residential gateway 300 
is coupled to the hybrid fiber-coaxial plant 1 1 2 in accord- 
ance with a preferred embodiment of the present inven- 
tion, it may be configured to provide the user with both 
infonnation data (e.g., through an Ethernet interface), 
telephony access, and TV service (e.g., HDTV, Digital 
TV and/or CATV sen/ices). In exemplary embodiments, 
the hybrid fiber-coaxial plant 112 typically Includes both 
coaxial cable and optlcai fiber networl<s, though, where 
desired, the networl< may include only coaxial cable or 
optical fiber. The hybrid fiber-coaxial plant 112 may be 
coupled to a head-end hub (HEH) 115. The head end 
hub 115 may provide an interconnection point to gather 
and/or transform external services (e.g., off air and sat- 
ellite video, public switched telephone network voice, 
and Internet data) Into a format suitable for distribution 
on the hybrid fiber-coaxial plant 1 1 2 for use with the cus- 
tomer premise equipment 102, The head-end hub 115 
may include one or more cable modem termination sys- 
tems (CMTS) 1 1 6 coupled between the hybrid fiber-co- 
axial plant 112, a Head-end (HE) 117 and/or an Edge 
Router (ER) 118. The edge router 118 may be coupled 
to the cable modem termination system 1 1 6 and to one 
or more ultra high speed routers (UHR) 121. One or 
more ultra high speed routers 121 may be interconnect- 
ed to each other and/or through a centralized mecha- 
nism such as an IP network database to form a high 
speed network, The high speed packet network 120n is 
one example of the network 120 (e.g., IP network) 
shown in Fig. 1 . 

[0096] In the embodiment shown in Fig. 4, the high 
speed network 120n includes the ultra high-speed rout- 
ers (UHR) 121 configured in a ring configuration. Al- 
though this embodiment shows the use of the IP network 
database (IND) 122, other configurations are also suit- 
able. Where an IP network database 122 is utilized, it 
may be desirable to incorporate one or more data sets 
such as: a IP local number portability database (IP LNP) 
122a which may be utilized for transferring local DN 
among service providers when a user changes their 
service provider; an IP caller name database (IP 
CNAME) 122b which may be utilized to provide a data- 
base of names relating to IP addresses and/or domain 
names; an IP line information database (IP LIDB) 122c 
which may provide alternative billing and allow flexibility 
in determining who pays for a call; and an IP 1 -800 Da- 
tabase (IP 8YY) 122d which may provide a database of 
1 -800 numbers relating to the IP network 120a. Alterna- 
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tively, the IP local number portability database may be 
located at another location, such as at an IP central sta- 
tion (IP Central) 130. Where desired, a local service 
management system (LSMS) 150 may be arranged to 

5 provide management of the iP local number portability 
database. Where a local service management system 
150 is utilized, a plurality of local service order adminis- 
tration (LSOA) units 152 may be coupled to the local 
service management system by, for example, a number 

10 portability administration center (NPAC) 151. In this 
manner, directory numbers may be transported among 
different service providers. In such a case, a NPAC 151 
is generally coupled to the LSMS 1 50 and uses the LS- 
MS 150 to synchronize the numbering databases and 

15 to coordinate the porting process. 

[0097] As indicated above, the broadband network 1 
may Include a plurality of interconnected high perform- 
ance networks 120n. Each high performance network 
1 20n may include a separate I P centrai station 200 and/ 

20 or share a single IP central station. Having distributed 
IP central stations located throughout the broadband 
network 1 provides improved performance and quicker 
response time for an individuai user. Although not iilus- 
trated, each high performance network 120, 120n may 

25 be connected to multiple head-end hubs 115, each 
head-end hub 115 may be connected to multiple hybrid 
fiber-coaxial plants 112, and each hybrid fiber-coaxial 
plant 112 may be connected to a plurality of customer 
premises equipment 102, each containing one or more 

30 broadband residential gateways 300. The plurality of 
high performance networks 120n may be configured as 
an interconnected network for routing packetized infor- 
mation from point-to-point in accordance with a desired 
destination. 

35 [0098] The high performance network 120n may be 
configured to provide connectivity for and between a 
plurality of head-end hubs 115 and/or a plurality of 
broadband residential gateways 300 and other net- 
works such as the Internet, e.g., www 180, the public 

40 switched telephone network (PSTN) 160 and/or various 
signaling systems such as the SS7 network 1 70 for end- 
to-end voice over IP applications. The IP central station 
200 may be configured to provide seamless integration 
and control of the high performance network 120 (e.g., 

45 an IP based communication system) interface with the 
public switched telephone networks (PSTN) 160, sign- 
aling system seven (SS7) 170, and/or the Internet 180 
so that packetized data, voice calls, and other signaling 
information is properly transferred between the broad- 

50 band residential gateway 300 and the public switched 
telephone network 1 60 and Internet 1 80. In certain con- 
figurations, the hybrid fiber-coaxial 112, head-end hub 
115, and high perfonnance network 120, provide a sig- 
nal conduit for packetized voice and data which may, 

55 with the coordination of the IP central station 200, be 
provided in the appropriate format between the broad- 
band residential gateway 300, the public switched tele- 
phone network 1 60, and/or the www 1 80. 
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D. General Operation of Integrated Communication 
System 

[0099] The typical home user is currently required to 
purchase multiple intelligent data conduits such as mul- s 
tiple set-top boxes, a plurality of conventional, DSL and/ 
or ISDN phones, cable modems, HDTV receivers, sat- 
ellite receivers, home PC LANs, etc. The integrated 
communication system of the present invention pro- 
vides a user friendly versatile communication system io 
that enables voice over IP telephony, Information data 
(e.g., PC and Internet), and television services In a sys- 
tem with one Intelligent customer premise equipment 
1 02 Interface, the broadband residential gateway 300. 
The broadband residential gateway 300 In conjunction 
with the IP central station 200 provides a flexible com- 
munication system that can provide any number of In- 
tegrated communication service features and functions 
without requiring the user to become familiar with nu- 
merous, diverse types of equipment. 
[0100] In one exemplary application of the voice over 
IP operations, the broadband residential gateway 300 
digitizes the analog telephony signal using, for example, 
G.711 [L law coding (64 Kbps Pulse Code IVIodulation). 
The digital samples may then be packetized in, for ex- 25 
ample, the broadband residential gateway 300 into IP 
packets. The broadband residential gateway 300 may 
be configured to encapsulate the IP packets Into, for ex- 
ample, DOCSIS (Data Over Cable Service Interface 
Specifications) frames for transmission back to the so 
head-end hub (HEH) 115 over the hybrid fiber-coaxial 
plant 112. The hybrid fiber-coaxial plant 112 may then 
be configured to transport signals for both upstream (to 
head-end hub 202) and downstream (to the broadband 
residential gateway 300 and customer premise equip- 35 
ment 102) directions. Although the DOCSIS protocol Is 
utilized in this example, any future protocol may also be 
used for the digitizing and packeting of data. Where the 
protocol changes, it may be desirable to download new 
operating code from, for example, IP central station 200 to 
to the individual broadband residential gateways 300, to 
update thecommunication protocols dynamically When 
new protocols are adopted, the IP central station may 
utilize, for example, the system management server 2 1 6 
to download new protocol data into, for example, the 45 
protocol manager in the call manager 21 8 and the pro- 
gram store 330 In the broadband residential gateway 
300. 

[01 01 ] Where voice packets are sent over constant bit 
rate (CBR) channels using unsolicited grants, additional so 
packet data channels may be used to support signaling 
messages (e.g., SGCP, Simple Gateway Control Proto- 
col), high-speed cable modem service and/or other up- 
stream packet data services. The upstream packet data 
services may be sent using available bit rate (ABR) 55 
channels such that the voice channels not Impacted by 
data traffic. 



1 . TV Signal Reception 

[0102] The head-end 11 7 may originate CATV signals 
for transmission overthe distribution network. However, 
In alternate embodiments, signals may be inserted at 
other points in the distribution network, such as at vari- 
ous hubs or may arise at remote locations in the network 
such as IP central. Down stream channels may be uti- 
lized to facilitate the transmission of signals from the 
head-end or other Input distribution point to the sub- 
scriber premise. Where analog RF signals arrive at the 
broadband residential gateway 300 of the customer 
premise equipment 102, typically, the transceiver cir- 
cuitry 302 will detect If the signal Is addressed to this 
broadband residential gateway 300. If so, the transceiv- 
er will allow reception of the RF signal. Upon conversion 
to a digital format, the signal Is typically output over the 
high speed bus (HSB) 360 to one or more associated 
devices for processing. For example, where the signal 
is a TV signal, the signal may be output directly to the 
TV port 336 and/or processed by the set top box 350 
prior to outputting to the TV ports 336 and/or display 
338. Where user channel selection is preformed directly 
in the broadband residential gateway 300, channel se- 
lection may be preformed by remote control receiver 
365 using an external device such as a remote control. 
The remote control receiver may receive a plurality of 
individually coded remote control commands from dif- 
ferent receivers and process the signals for only one as- 
sociated device In accordance with the received com- 
mands. Alternative channel Inputs Include the display 
338 and/or any associated keypad. Authorization to cer- 
tain channels may be controlled by security processor 
340. 

[0103] Where a remote set top box Is utilized, the box 
may be coupled directly to the HFC for individual fre- 
quency tuning and/or receive a digital feed from the 
broadband residential gateway 300 after decoding the 
digital signal. For example, where hybrid fiber-coaxial 
plant 112 contains fiber connections to locations near 
the individual homes, it may be desirable to download 
one or more simultaneous individually requested pro- 
gramming stream(s) and/or digital data stream(s) to the 
broadband residential gateway 300. In this manner, the 
number of channels, movie selections, and/or entertain- 
ment options available to the user are unlimited. Cost is 
minimized since only a single Intelligent user interface 
Is used In the home and all televisions, phones, com- 
puters, and/or other user interface devices use the same 
Intelligent user Interface to the broadband network 1 . In 
this manner, the broadband network 1 may offer premi- 
um television, voice and/or data services to multiple 
conventional televisions, phones, and PCs without the 
use of multiple set boxes, modems, and external con- 
nections. Thus, the users are provided a single unified 
Interface to satisfy their external data needs. 
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2. Exemplary Call Flow of an On-Network Call to an 
Off-Network Call, with the Off-NetworkCall initiating 
the Dropping 

[0104] Fig. 5 illustrates an exemplary call processing 
sequence for an on-net call (e.g., an IP based call) to 
an off-net call (e.g., a public switched telephone network 
based call), in which the off-net party initiates the drop 
call sequence. The exemplary call processing sequence 
operates as follows: 

1 . Once the broadband residential gateway 300 de- 
tects an off hook condition, the broadband residen- 
tial gateway 300 may generate an off hook signal 
508 to the call manager (CM) 218. The off hook sig- 
nal acts as a dial tone request to the call manager 
218. Alternatively, the broadband residential gate- 
way 300 may collect all dialed digits before activat- 
ing the off hool< condition. This alternative may be 
desirable to save resources at the call manager 21 8 
where multiple incoming lines are available to han- 
dle any additional calls. Thus, even though one 
phone is off-hook, the broadband residential gate- 
way 300 determines that other lines are available 
and does not initiate the off-hook signal until all di- 
aling digits have been collected. 

2. Where the call is managed entirely by the call 
manager, the call manager21 8 will issue a dial tone 
message 509 to the requesting broadband residen- 
tial gateway 300 in order for the broadband residen- 
tial gateway 300 to generate a dial tone to the as- 
sociated phone. Where the broadband residential 
gateway 300 shares management of the call, the 
broadband residential gateway 300 generates the 
dial tone in response to the off-hook condition. 

3. Where the call is managed entirely by the call 
manager 21 8, the call manager 21 8 will then enter 
a state where it polls and collects the dialed digits 
510 from the broadband residential gateway 300. 
The dialed digits may then be transferred to the call 
manager 21 8 one at a time as they are entered. Al- 
ternatively, where the call set-up control process is 
shared between the broadband residential gateway 
300 and the call manager 218, the broadband res- 
idential gateway 300 collects the dial digits and 
transfers these, together with the off-hook signal to 
the call manager 21 8. Th is transfer may be facilitat- 
ed by combining this data into a single data packet. 

4. On receiving the dialed digits, the call manager 
21 8 will detemnine whether local number portability 
has been enabled. Where local number portability 
has been enable, the call manager 218 may issue 
a local number portability (LNP) query 511 to the IP 
local number portability database 122. The IP local 
number portability database 122 may then supply 
the call manager 218 with a routing number 512 if 
the dialed digits form a valid sequence. Where the 
dialed digits do not form a valid sequence, the call 



manager 218 will return an error indication to the 
broadband residential gateway 300. The error des- 
ignation may include a tone and/or a more detailed 
error message for display on, for example, display 

5 338. 

5. Where the call sequence is valid, the call man- 
ager 21 8 may issue a first call proceeding message 
513 to the broadband residential gateway 300 indi- 
cating that the number is valid and the call is pro- 

10 ceeding (e.g., a valid on-hook condition). 

6. Next, the call manager 21 8 typically determines 
whether adequate network resources are available 
to carry the call. In embodiments where the broad- 
band residential gateway 300 Is connected to a hy- 

15 brid fiber-coaxial plant 112, the call manager 218 
may send an open gate allocation request 514 to 
the cable modem transmission system 116. In this 
event, It Is often desirable for the cable modem 
transmission system 116 to provide a gate alloca- 

20 tion acknowledgement 515. A gate allocation ac- 
knowledgement may be utilized to verify that the 
necessary gate resources have been allocated. 

7. The call manager 218 may send an open con- 
nection request 51 6 to the voice gateway (VG) 232 

25 in order to provision the connection. Once the con- 
nection is provisioned, the VG 232 may provide an 
open connection acknowledgement 51 7 back to the 
call manager 21 8. 

8. For off network connections, it is often necessary 
30 to enter a second phase of the connection process 

involving the appropriate link signaling to establish 
a call. For example, the call manager 21 8 may send 
an ISUP lAIVI (Initial Address) message 518 con- 
taining the directory number (DN) of the called party 

35 to the signaling gateway (SG) 234. This process is 
often utilized to allocate the appropriate voice trunk 
for communication. The call manager 21 8 may also 
send an alerting message 51 9 1 the broadband res- 
idential gateway to produce an alerting signal, e.g., 

40 a ringing tone. The signaling gateway 234 may 
make the appropriate connections when the trunk 
has been allocated and acknowledge the request 
with an ISUP A call manager (Address Complete) 
message 520. 

45 9. Once the called party has answered the call and 
connection is established, the signaling gateway 
234 may send an ISUP ANM (Answered) message 
521 to the call manager 218 Indicating that the 
called party has answered. 

50 1 0. The call manager 21 8 may then send a call start 
message 522 to the accounting gateway (AG) 240, 
indicating the start of the call. The AG 240 may use 
this information for billing purposes. 
11 . At this point, the link has been established and 

55 the conversation 523 can proceed over the commu- 
nications path. Note that although signaling system 
7 (SS7) signaling is used herein to illustrate the 
present invention and is a well known signaling pro- 
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tocol utilized in the art of telephony telecommunica- 
tion, the instant invention is not limited to the use of 
signaling system 7 (SS7) signaling for call estab- 
lishment of an off-network call; the use of signaling 
system 7 (SS7) signaling is merely illustrative. As 
such, other methods of signaling may be substitut- 
ed for signaling system 7 (SS7). 

1 1 . When the called public switched telephone net- 
work user terminates the link, an on hook signal 
may be sent to the appropriate public switched tel- 
ephone network switch, such as a SESS. The sig- 
naling network may then send a call tennination 
message (not shown) to the signaling gateway 234 
as notification of the caii termination status. 

12. The signaling gateway 234 may then generate 
a release 524 signal to the caii manager 21 8. 

13. Upon receipt of the release 524 signal, the call 
manager 218 may a) initiate the relinquishment of 
the provisioned network resources by issuing a 
close connection 525 message to the voice gate- 
way (VG) 232 and a release complete 526 message 
to the signaling gateway 234, b) inform the account- 
ing gateway that the call has been terminated, for 
billing purposes via, for example, sending a call end 
527 message to the accounting gateway 240. 

1 4. With reference to the close connection 525 mes- 
sage, the voice gateway may respond by issuing a 
report message 528 to the caii manager 218 con- 
taining the current status of the caii. 

15. On receiving the caii status report 528, the caii 
manager 218 may issue a delete connection 529 
message to the broadband residential gateway 
300. 

16. The broadband residential gateway 300 may 
then releases its resources and sends a status re- 
port 530 to the caii manager 218. in addition to the 
report 530, the broadband residential gateway 300 
may also send an on hook 531 status report to the 
call manager 21 8. 

17. The call manager 218 may then inform the 
broadband residential gateway 300 to report the 
next off hook condition via message 532. 

18. Where a cable modem transmission system is 
utilized, the call manager 21 8 may then issues a re- 
lease gate 533 message to the cable modem trans- 
mission system 116 so that all the modem resourc- 
es can be relinquished. Once the gate resources 
have been released, the cable modem transmission 
system 118 sends a release gate complete 534 
message to the caii manager 21 8. At this point, ail 
resources pertaining to the caii have been relin- 
quished. 

3. Exemplary Call Flow of an On-Network Call to 
another On-Network User, Under One Call Manager 
Control 

[0105] Fig. 6 illustrates an exemplary call flow of an 



on-network call to another on-network user, with the call 
being handled by a single call manager (CIVI) 218. In 
alternate embodiments, different portions of the call set- 
up sequence may be handled by more than one call 
5 manager 21 8 in the IP network 120. The exemplary "on- 
network" call processing sequence operates as follows: 

1 . Once the broadband residential gateway 300A 
detects and off hook condition of, for example, a tel- 

10 ephone, the broadband residential gateway 300A 
may generate an off hooksignal 607 to the caii man- 
ager (CiVI) 218. The off hook signal may act as a 
dial tone request to the caii manager 21 8. 

2. The caii manager 21 8 may then issue a dial tone 
15 message 608 to the requesting near-side broad- 
band residential gateway 300A in order for the 
broadband residential gateway 300A to generate a 
dial tone. 

3. The call manager 218 may then enter a state 
20 where it polls and collects the dialed digits 609 from 

broadband residential gateway 300A. The dialed 
digits are transferred to the call manager 218 one 
at a time. In a similar fashion to the subject matter 
discussed above, in embodiments where the call 

25 setup is shared between the call manager 21 8 and 
the broadband residential gateway 300A, the 
broadband residential gateway may manage the 
caii set-up and transfer both the off-hook signal and 
the dialed digits to the caii manager 21 8 within one 

30 or more. 

4. On receiving the completed dialed digits, the call 
manager 218 may issue a local number portability 
query 610 to the IP local number portability data- 
base 122. The IP local number portability database 

35 122 may then supply the caii manager 21 8 with a 
routing number 611 if the dialed digits constitute a 
valid sequence. 

5. The call manager 218 may then ensure that ad- 
equate network resources are available to accom- 

40 modate the call. 

6. Where adequate resources are available, the call 
manager 218 may issue a first setup message 61 2 
to whatever mechanism couples the far side broad- 
band residential gateway 300, e.g., the cable mo- 

45 dem transmission system 11 6B, to allocate trans- 
mission resources on the far side. 

7. A call proceeding message and a report on hook 
condition message 613 may then be sent to the 
broadband residential gateway 300A. 

50 8. A gate allocation message 61 4 may then be sent 
from the caii manager 218 to the cable modem 
transmission system 116A, where the broadband 
residential gateway 300A is coupled via a cable mo- 
dem transmission system. In this environment, a 

55 gate allocation 61 4 message may be utilized to set 
up the relevant modem resources. 
9. Where a cable modem transmission system is 
utilized and receives the setup message 612 from 
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call manager 218, the cable modem transmission 
system 116B may then send a connection request 
61 5 message to the far side broadband residential 
gateway 300B. 

10, Where a cable modem transmission system s 
1 1 6B is utilized, the cable modem transmission sys- 
tem may then sends a setup acl<nowledgement 61 6 

to call manager 218. Once the resources are allo- 
cated by the cable modem transmission system 
11 6A, the cable modem transmission system may io 
then send a gate allocation acknowledgement mes- 
sage 61 7 back to the call manager 21 8. 

11 , Once the call manager 218 receives the setup 
acknowledgement 616 along with the gate alloca- 
tion acknowledgement message 617, the far-side 
broadband residential gateway 300B may then 
send a ringing message 618 to the far-side cable 
modem transmission system 116B where this con- 
nectivity is utilized, 

12, In these embodiments, the far-side cable mo- 20 
dem transmission system 1 1 6B may then issue an 
alerting message 61 9 to the call manager 218. 

13, The call manager 21 8 may then convey the alert 
via an alerting message 620 to the broadband res- 
idential gateway 300A, to produce a indicating sig- 25 
nal such as a ringing signal Indicating that the call 

is going through. 

14, The cable modem transmission system 116B 
may then issue a connect message 622 to the call 
manager218 in response to the far-side broadband so 
residential gateway 300B sending an off hook mes- 
sage 621 to the far-side cable modem transmission 
system 11 6B. At this point, the end-to-end commu- 
nication path is established and conversation 623 
can be facilitated. 35 

15, Assuming that the calling party hangs up first, 
the broadband residential gateway 300A may initi- 
ate an on hook sequence 624 message which may 
be communicated to the near-side cable modem 
transmission system 116A. 40 

16, The cable modem transmission system 116A 
may then issue a disconnect message 625 to the 
call manager (CM) 218. The call manager 21 8 may 
then issue a first delete connection request 626 to 

the near-side broadband residential gateway 300A 45 
and then a second delete connection request 627 
to the far-side broadband residential gateway 300B. 

17, The near-side broadband residential gateway 
300A may respond to the call manager 218 with a 
report message 628 containing the connection sta- so 
tus, as well as an on hook message 630 to verify 
that the calling party at near-side broadband resi- 
dential gateway 300A has terminated the call. 

18, The far-side broadband residential gateway 
300B may respond to the call manager 21 8 with a 55 
report message 629 containing the connection sta- 
tus, as well as an on hook message 631 indicating 
that the called party connection has now been ter- 



minated. 

19. At this point, the call manager 218 may issue 
release gate messages 634 and 635 to the near- 
side cable modem transmission system 218 and far 
side cable modem transmission system 11 6B, re- 
spectively, so as to release the modems associated 
with the call. Once all the resources have releases, 
the cable modem transmission system 116A and 
the cable modem transmission system 116B may 
issue gate release complete messages 636 and 
637 respectively to the call manager 21 8. 

20. For simplicity, the accounting processing is not 
shown. However, the process used in Fig. 5 may be 
utilized as the billing procedure for on-net calls. 
Such a process might constitute sending a call start 
message from the call manager 218 to an account- 
ing gateway (AG) 240 after the connect message 
622 is sent from the far-side cable modem trans- 
mission system 116Bto call manager 21 8. The call 
start message would trigger the start of the billing 
procedure. A corresponding call end message 
would then be sent from the call manager 21 8 to the 
AG 240 after the near-side cable modem transmis- 
sion system 11 6A sends a the disconnect message 
625 to the call manager 21 8. This call end message 
would trigger the ending of the billing procedure for 
that call. 

[0106] Although the IP voice packets for these calls 
are typically routed over the IP network 120, the system 
may, where appropriate, route IP voice packets over the 
Internet 180. 

II. Multimedia Messaging Service 

[0107] The present invention further provides for a 
multimedia messaging service which maybe used inthe 
aforementioned, facilities-based, end-to-end broad- 
band communication network infrastructure that may in- 
clude integrated telephone, television and data network 
communications. The broadband network multimedia 
messaging service provides an any-media messaging 
service to the broadband communication network sub- 
scriber (user). The broadband communication network 
subscriber may send and receive messages in a variety 
of formats such as e-mail (text), voice mail (audio), or 
multimedia video mail (audio and video). The system 
may provide for storage of sent and received messages, 
message waiting notification capabilities which may be 
programmed by the user, user programmable message 
media type conversion, message sorting and pnoritiz- 
ing, and user programmable location for message stor- 
age and archive. 

[0108] The broadband network 1 components most 
involved In the multimedia messaging service may in- 
clude the multimedia server (MS) 222, the call manager 
(CM) 218, the announcement server, and the broad- 
band residential gateway (BRG) 300. The multimedia 
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server 222 may be configured as the primary storage 
and intelligence center to support e-mail (e.g., html) 
messages, voice mail (audio) messages, and/or video 
mail (audio and video) messages. The multimedia mes- 
sages may include standard pre-configured system s 
messages and/or user defined messages instructing 
callers to leave a message. In any event, where the 
messages are stored in a centralized location, the mul- 
timedia server may provide such storage. On the other 
hand, the BRG's 300 memory 322, a PC connected to io 
the BRG's 300 data port 334, or a disk drive connected 
to the BRG's 300 peripheral port 342, may provide such 
storage, in either case, a database may be utilized for 
indexing, storage, and retrieval of such messages, in 
exemplary systems, the user may access predeter- 
mined ones of these messages. The CiVI 21 8 may direct 
incoming calls AS 220 after a predetermined number of 
rings and the AS 220 will provide a message to the caller 
Indicating to leave a message. The CM may tlien direct 
the message left by the caller to the MS 222. 20 
[0109] In one embodiment, the Multimedia Server 
(MS) 222 provides support for multimedia messaging 
service for the integrated communication system. MS 
222 may provide the overall management of mail mes- 
sages received in e-mail (text), voice mail (audio) or vid- 25 
eo mail (audio and video) format. The mail messages 
maybe indexed in a database for retrieval based on user 
input. The multimedia server may use IP as the pre- 
ferred method of communication. 

[0110] Referring now to figures 7A and 7B, an exem- 30 
plary process for the multimedia messaging sen/ice 
storing messages and providing notification to the 
broadband networi< subscriber is provided. First, at step 
701 a party calls the broadband networlt subscriber and 
the CM 218 directs the call to the called parties BRG as 
300. Next, at decision step 702, the CM 218 determines 
if the called party has indicated that incoming calls be 
forwarded to the message box immediately rather than 
alerting the called party. If not, then at decision step 703, 
the system awaits the called party's answer. If the called 40 
party answers the call the CM 21 8 may set up the call 
at step 704. If the called party has indicated that the call 
is to be directed immediately to the message box, then 
the system proceeds to step 705. Further, if the called 
party does not answer the system proceeds to step 705. 45 
At step 705, the system may, for example, query the an- 
nouncement server (AS) 220 of the multimedia server 
(MS) 222, to determine if the called party has a pre-re- 
corded personal message. This message may be 
unique for a particular calling party (e.g., boss) or class so 
of calling party (e.g., friends, family, etc.). If the called 
party does not have a personal pre-recorded message 
then the system plays the system default message at 
step 706 indicating that the caller may leave a message 
of any media type and indicate a priority, then proceeds ss 
to step 71 2 for storing the message according to, for ex- 
ample, media type and priority, if the called party does 
have a pre-recorded personalized message the system 



(e.g., the CM 21 8) proceeds to decision step 707 to de- 
tect thetype of equipment being used by the calling par- 
ty and the bandwidth available to playbacl< the pre-re- 
corded message. If the system can not detect the calling 
party's equipment type, then it plays the system default 
message at step 706 which is stored in, for example, the 
AS 220 orthe MS 222. Othenwise, the system proceeds 
to step 708 and plays back the called party's pre-record- 
ed message stored in, for example AS 220 or the MS 
222, to the calling party. In any case, the call manager 
CM 218 directs the call to, for example, the announce- 
ment server 220 or the multimedia server 222, which 
plays a message indicating that the calling party may 
leave a message using whatever type of media (e.g., 
email, voice mail, video mail) and indicate a priority for 
the message, as indicated at steps 706 and 708. 
[0111] Then, if a personalized pre-recorded message 
is played back at step 708, at decision step 709 the sys- 
tem (e.g., CM 218) detemiines if the called party has set 
a no message allowed status for the calling party. This 
may apply to all callers or to particular callers as pre- 
programmed by the called party. If the called party has 
set a no message option, then the call is disconnected 
at step 71 0. Next, at step 71 1 , the calling party may gen- 
erate a voice mail, text message, or video mail, This 
message creation may occur in any of a number of serv- 
ers such as the CM 218, AS 220, or MS 222. If not al- 
ready at the multimedia server 222, the CM 218 may 
direct the call to the multimedia server 222, where the 
message is stored according to the media type, e.g., 
text, audio, or audio and video along with a priority indi- 
cator, as shown in step 71 2. Next, at step 71 3, the called 
party may be provided a notification that a message is 
waiting by, for example, the multimedia server 222 send- 
ing a message to the called party's BRG 300. 
[0112] As indicated in step 714, alternatively a party 
may send a broadband network subscriber a message 
without calling the subscriber, by sending an email, 
voice mail, orvideo mail message that was pre-recorded 
by the party by sending it to, for example, the subscrib- 
ers email address, IP address, or DN. The pre-recorded 
message may contain an indicator that it is a message 
so that the CM 21 B does not attempt to set up a call but 
instead directs the message directly to, for example, the 
multimedia server 222 or the BRG 300. 
[0113] Referring now to Figure BA, an exemplary 
process for the multimedia messaging service notifica- 
tion to the broadband network subscriber that a mes- 
sage(s) is waiting. First, at step 801 , the broadband cus- 
tomer premise equipment (CPE) intelligent transceiver, 
for example BRG 300, receives notification of a mes- 
sage(s) waiting. Next, at decision step 802, a determi- 
nation is made as to whether the CPE intelligent trans- 
ceiver, for example the BRG 300, includes means for 
immediately alerting the subscriber that a message is 
waiting, for example, the BRG 300 has an active display, 
an active message waiting indicator light, and/or an ac- 
tive intercom with speaker, if so, at step 803, a message 
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waiting notification is sent to the active device (e.g., dis- 
play, indicator ligint, intercom) indicating, for example, 
that there is a message waiting, the media type of the 
message, the number of messages waiting, who sent 
the message(s), etc. Since the system has multimedia 
message capability, the message waiting notification 
may include, for example, a graphic displaying a picture 
of the person who left the message or a logo of the com- 
pany leaving the message (for example if the message 
is a solicitation). Next, the process would continue by 
awaiting the broadband networic subscriber's request to 
receive his message(s) (see Fig. 8B at step 815). if there 
is not an active device associated with the CPE intelli- 
gent transceiver so that a message waiting notification 
alert can be provided immediately, the process awaits 
the subscriber to turn on one of the CPE which will allow 
a notification to be provided (see Fig. 8B at step 811 ). 
[0114] Referring now to Fig. 8B, an exemplary proc- 
ess for the multimedia messaging service notification of 
message waiting and subscriber access of message log 
is provided. At step 81 1 , the broadband communication 
system (BOS) subscriber turns on one of the customer 
premises equipment (other than the BRG 300), for ex- 
ample the TV 1 06 or PCI 08, or the subscriber picks up 
a telephone 110 head set. Then, for example, the BRG 
300 determines whether a message is waiting for review 
by the subscriber(s) at step 812. This determination may 
be made by, for example, the BRG 300 accessing a 
message waiting file stored in its own memory 322, or 
requesting message waiting status from the multimedia 
server 222. In any case, if there is no message waiting 
for the BCS subscriber(s), then the BRG 300 may con- 
tinue to periodically determine if a message is waiting. 
In the case when a message is waiting for the BCS sub- 
scriber, the BRG 300 may determine whether the TV 
1 06 or PC 1 08 are turned on at step 81 3. if the TV 1 06 
and/or PC 1 08 is turned on then the BRG 300 may send 
a message waiting notification to the TV 1 06 and/or PC 
1 08 indicating the message media type and the number 
of messages waiting by using, for example, a message 
board on the display of the TV 1 06 and/or PC 1 08 (see 
Figs. 9 and 10) or provide a voice synthesis message 
generated by the voice recognition and voice synthesis 
355 of the BRG 300 or IVIS 222. 
[0115] On the other hand, if the TV or PC is not on, 
the BRG 300 may determine if one of the telephones 
110 is off hool< at decision step 81 6. If there is not a tel- 
ephone 110 off hool<, then the BRG 300 may continue 
to monitorwhether there are any messages waiting and 
provide alerting via its own display 338, indicator light, 
and/or intercom 344. However, if there is a telephone 
11 0 off hook, the BRG 300 may send an audio message 
waiting alert to the telephone indicating, for example, 
that a message is waiting for which subscriber, what 
type of media the message is in, and how many mes- 
sages of which type of media are available. The BRG 
300 and IVIS 222 may allow the BCS subscriber to ac- 
cess any media type messages in audio format with the 



telephone by using, for example, pattern recognition 
and voice synthesis if needed. 
[01 1 6] Next, at decision step 81 5, the broadband net- 
work determines whether the BCS subscriber has re- 
5 quested review of the messages waiting. This determi- 
nation may be made by, for example, the BRG 300 or 
the MS 222. If the subscriber has not requested review 
of pending messages the system returns to step 812 
and periodically updates a message waiting status log. 
10 If the BCS subscriber requests review of waiting mes- 
sages, the system, for example the BRG 300 of IVIS 222, 
may request that the subscriber enter their login identity 
and a password at step 81 8. Then, at step 81 9, the sys- 
tem checks to make sure the login ID and password en- 
's tered are correct for the access to the message(s) wait- 
ing. If the login ID and password are not correct after a 
number of tries by the subscriber, the system, for exam- 
ple the BRG 300 or IVIS 222, will return to step 81 2 and 
determine if a message is waiting, On the other hand, If 
20 the login ID and password are correct, then at step 820 
the system provides the user a log of their messages in 
the appropriate format and media type according to the 
type of device they are operating; TV 1 06, PC 1 08, and 
telephone 110. The log of messages may include both 
25 new and old messages, as well as messages sent by 
the subscriber to others, and the log may be generated 
by either the BRG 300 and/or MS 222 and copies of the 
messages may be maintained in memory, inforexample 
the BRG 300 and/or MS 222. 
30 [0117] Referring now to Fig. 8C, an exemplary proc- 
ess for the multimedia messaging service message re- 
trieval and archive is provided. To retrieve a message 
waiting which is presented in a message log provided 
at step 820, the subscriber may, for example, click on 
35 the message identifier. Then, at step 831 , the system, 
for example the BRG 300 or MS 222, determines that 
the subscriber has selected a message (new or old) to 
review. Then at step 833 the system, for example the 
BRG 300 or MS 222, determines if the subscriber has 
to designated a particular media type for reviewing mes- 
sages (see Figs. 11 and 12). This media type selection 
for reviewing the message(s) may be provided actively 
by preprogramming or passively by selection of a par- 
ticular type of CPE, for example the telephone 110 or a 
45 PC 1 08 without multimedia capabilities. Further, the me- 
dia type selection may be performed real time while the 
subscriber is retrieving his messages. Then, if the sub- 
scriber has selected a particulartype of media to review 
his messages and that type is supported by the CPE 
50 device he is using, then the system, for example, the 
BRG 330 or the MS 222, will convert the message to the 
particular media type selected by the subscriber (if not 
already in the desired media type) , at step 835. Th is con- 
version may be done in advance or in real time. If there 
55 is no particular media type selected by the subscriber 
or required by the CPE being used (e.g., telephone), 
then at step 834 the system, for example the BRG 300 
or the MS 222, presents the message to the subscriber 
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using the media type by winicli the message was origi- 
nated and/or stored. Alternatively, the BRG 300 may 
send a system message to the MS 222 indicating the 
type of CPE 1 02 that is currently active and been used 
to review the message waiting. The l\/IS222 may choose 5 
an appropriate playback device, e.g., voice synthesis for 
text-to-voice conversion or voice recognition for voice- 
to-text conversion, according to the type of CPE 102 be- 
ing used by the subscriber to review the message wait- 
ing. Further, the IVIS 222 may use different coding/de- io 
coding techniques according to the detected bandwidth 
to deliver the mail message along the path that is avail- 
able. If the subscriber has a service level agreement 
(SLA) with the service provider for a guaranteed band- 
width, the IVIS 222 may try to reserve a bandwidth with 
the broadband communication system (or portions 
thereof) if the user requires higher bandwidth such as 
for reviewing a multimedia video and audio message 
waiting. 

[0118] In any case, next at step 836 the system de- 20 
termines if the message selected by the subscriber is to 
be archived. If the message is to be archived, the sys- 
tem, for example the BRG 300 or MS 222, may store 
the message in, for example, a central storage, a sub- 
scriber CPE 102 (e.g., BRG 300, PC 108), and/or any 25 
othersubscrlberdesignated storage device, at step 837. 
The system may also retain the message in memory for 
a predetermined amount of time according to a system 
default period of time or a subscriber defined period of 
time, e.g., 10 days, after the message has been re- so 
viewed. In either case, the system returns to step 831 
to await for the subscriber to select a message. If the 
subscriber does not select a message to review the sys- 
tem at decision step 832 determines if the subscriber 
has requested to end message retrieval. If so, the sys- 35 
tem returns to step 802 and continues to provide mes- 
sage waiting notification to the subscriber in accordance 
with messages waiting to be reviewed. Otherwise, the 
system will continue to provide the message log infor- 
mation. 40 
[0119] As illustrated in Figs. 9 and 10, a Graphical Us- 
er Interface (GUI) maybe provided on a display 901 , for 
example, as one means for notifying a user that a mes- 
sage is waiting and enabling the user to retrieving and 
store messages. The GUI provides the user with a single 45 
means for identifying and accessing all the various me- 
dia types of mail messages which are stored and await- 
ing review; whetherthe mail message is in e-mail, voice- 
mail, or multimedia video mail format. The GUIs of Figs. 
9 and 1 0 may be used on any display, for example, the so 
display of a TV 106, the display of a PC 108, and/or the 
display 338 of the BRG 300. In any case, as shown in 
Fig. 9, a scrolling or stationary message board 901 may 
be provided to indicate to the subscriber that a message 
is waiting for review. The subscriber to whom the mes- 55 
sages waiting a redirected is identified by, for example, 
their particular directory number, illustrated as DN1 903. 
However, the subscriber notification could be a name or 



an image, e.g., picture or the subscriber. The message 
board may also provide an indicator showing the type 
of media of the messages waiting, e.g., envelop 904 for 
text messages (or a speaker for audio messages and a 
video recorder for multimedia messages) and the 
number of messages in a particular type of media. 
[0120] In one embodiment in which the GUI of Fig. 9 
is displayed on, for example a TV 1 06, message waiting 
notification and message retrieval may operate as fol- 
lows. First, while the subscriber is watching TV 1 06 the 
message board 902 would appear in one area of the 
display 901, for example, the bottom of the display. 
Alerting the subscriber of the arrival of a new message 
waiting may be provided by an audible sound orflashing 
of an image on the display. If the message is not re- 
trieved, the message board and/or alerting may be ac- 
tivated intermittently. The subscriber may then retrieve 
the message(s) by using either the TV 1 06 if the TV 1 06 
is equipped with an input device such as a keypad, mi- 
crophone with voice recognition, infrared remote con- 
trol, etc. Otherwise, the subscriber may retrieve the 
message(s) using a PC 108, telephone 110, orthe BRG 
300 if the BRG is equipped with a display 338 and/or 
Intercom module 344. Once the subscriber has Indicat- 
ed they wish to retrieve a message waiting, the system, 
for example the BRG 300 or MS 222, will prompt the 
subscriber for a subscriber identification, for example a 
directory number (DN) or a name, and a password as- 
sociated with the subscriber identity. An example of 
such a prompt as provided via display 901 is shown in 
Fig. 10, IVIessage Console Login Window 1002. In re- 
sponse, the system provides the subscriber a message 
log which identifies the messages in the subscribers 
mail box. Once the message(s) has been read the mes- 
sage board 902 will disappear until a new message ar- 
rives. 

[0121] In anotherembodimentin which the GUI of Fig. 
1 0 is displayed on, for example a PC 1 08, message wait- 
ing notification and message retrieval may operate as 
follows. The subscriber turns on the PC and may be ei- 
ther prompted by message board 902 that a message 
is waiting to which the subscriber responds by selecting 
on a particular Icon , or may select an icon representative 
of the subscriber's mail box. In any case, the subscriber 
may be presented with Message Console Login Window 
1002 and/or Notification Window 1001. The subscriber 
then enters a subscriber identification (e.g., DN or 
name) and password. In response the system, if it has 
not already, may provide the Notificatton Window 1001 
indicattng the media type and number of new messages 
waiting is presented on display 901 . Upon selecting one 
of the media types (or all types), the system provides 
the subscriber a message log which identifies the mes- 
sage(s) of that media type in the subscribers mail box. 
The subscriber can then retrieve the message(s) of their 
selecting. 

[0122] In a still further embodiment the GUIs of Figs. 
9 and 1 0 may be used with the display 338 of the BRG 
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300. In this case, a user may touch an icon on message 
board 902 or notification window 1001, representing a 
pending email, voicemail and/or multimedia mail mes- 
sage. The panel may send an electronic signal to the 
processing controller 306 and/or an attached processor 
such as the telephony processor PI 308. On receiving 
the signal, the PI telephony processor 308 may gener- 
ate an IP pacl<et via the transceiver 302 across portions 
of the broadband network 1 tothemultimediaserver222 
In IP central station 200. The multimedia server 222 may 
authenticate the request by, for example, verifying loca- 
tion of the request and/or the identity and password of 
the requesting party. Where identity of the calling party 
Is being verified, the user may enter an access pass- 
word by an audio and/or keyboard request. Where an 
audio request Is generated, the user may utilize the ex- 
ternal / internal intercom module 344 of the broadband 
residential gateway 300, or via a text message entered 
Into the display 338. The user may then enter the ap- 
propriate subscriber identity and password via the on- 
screen soft keypad, microphone, and/or keyboard. 
[0123] Alternatively, if the message is stored locally in 
the broadband residential gateways 300 memory 322 
and there is not a password lock on the broadband res- 
idential gateway 300, the user may not have to enter a 
password to access the message. Where the message 
is stored locally in the broadband residential gateways 
300 memory 322 rather than IP central station, the dis- 
play 338, telephone 110, TV 106, or PC 108 may simply 
recall the message from memory 322 and presents to 
the user to provide one-touch instant message retrieval. 
In embodiments where the broadband residential gate- 
way 300 supports multiple mailboxes, the icons on the 
display 901 may be personalized to show the identity of 
the owner of the message. Each user may have a dif- 
ferent password to ensure privacy of access. 
[0124] Further, as indicated above, the system of the 
present invention may provide the user control of the 
type of media by which the stored mail messages are to 
be retrieved and reviewed, regardless of thetype of me- 
dia used to create and store the message. For example, 
if a user has an e-mail message the subscriber may in- 
struct the IP network multimedia message service to 
transform the text of the e-mail message into an audio 
message using, for example, pattern recognition and 
voice synthesis. Similarly, if a user has an audio voice- 
mail message the system may transform the audio into 
a text (e-mail) message using voice recognition. If there 
is no subscriber choice designated the MS 222 may au- 
tomatically detect the CPE 1 02 type being used by the 
subscriber to receive the message waiting. 
[0125] Referring to Figures 11 and 12, one method for 
converting media type is provided for the multimedia 
messaging service. First, at step 1101 the broadband 
communication system subscriber may request to des- 
ignate a media type for reviewing their message(s). This 
request may occur at a time prior to receipt and review 
of the message(s) or in real time when the subscriber 



wishes to retrieve and review the message. In either 
case, the subscriber inputs to the system which type of 
media they desire to review their messages. For exam- 
ple, the subscriber may be planning to be traveling and 

5 will only be able to access the system via a cellular tel- 
ephone. Thus, the subscriber may preprogram the 
broadband network multimedia messaging service to 
convert all his messages into audio so that he can listen 
to them with the audio portion of his cellular telephone. 

10 Or, the auto detection feature may result in message 
media type conversion. 

[01 26] To achieve pre-programming of the system to 
converting various messages to other desired formats 
a message type conversion menu may be provided us- 

'5 ing, for example, a GUI similar to the one illustrated in 
Figure 12. The message type conversion window GUI 
may include a "From" field 1 201 , a "To" field 1 202, and 
a "Status" field 1 204. The "To" field 1 201 and the "From" 
field 1202 contain an audio Indicator 1204, text Indicator 

20 1205, video indictor 1206, and an "AH" indicator, so that 
the subscriber can select to convert any combination of 
message types to any combination of message types. 
In the example provide above, when the subscriber 
wants to receive all his messages in audio format, they 

25 may select the "ALL" indicator 1207 in the From field 
1201 and the audio Indicator 1204 In the To field 1202 
so that the Status field 1203 would indicate conversion 
of message media type from text 1205 and video 1206 
to audio 1204 (not shown). Pre-programming of the 

30 message type conversion feature may also be achieved 
using a telephone by the system providing voice 
prompts (e.g., voice synthesis) and the subscriber in- 
putting their selection via the telephone keypad and/or 
voice responsive voice recognition. 

35 [0127] Then, using the pre-programmed information 
or media type selection information provide in real time 
at step 1102, for example the multimedia server 222 or 
the BRG 300 determines that the subscriber has select- 
ed converting message(s) to, for example audio, the 

*o multimedia server 222 or the BRG 300 may convert all 
video messages to audio messages by stripping of the 
audio portion and convert text messages (e.g., email) to 
audio using, for example, pattern recognition and voice 
synthesis at step 1 1 04. Alternatively, if message(s) are 

45 to be converted to text messages, the system would 
convert voice mail messages and audio portions of mul- 
timedia messages to text using, for example, voice rec- 
ognition at step 1103. Such a conversion may be partic- 
ularly useful if the subscriber is planning a trip and only 

50 has, for example, a palm pilot, hand held PC, or personal 
digital assistant (PDA), without audio capabilities to take 
along on the trip, and thus may preprogram the system 
to convert all his messages to a text format. 
[0128] Further, if messages are to be converted to 

55 multimedia type messages the system will first deter- 
mine whetherthe subscriber has selected a video image 
to be presented with the message converted to audio at 
step 1 1 05. For example, the subscriber might select an 
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animated figure image liaving a moutli to wliich the au- 
dio message will be added. Altematively, the image 
could be a still figure of the person who left the message 
with a moving mouth morphed over the still picture 
where the morphed mouth varies in a coordinated man- 
ner with the message converted to audio. If the subscrib- 
er has not selected a video image to combine with the 
message converted to audio, then the system will pro- 
vide a system default image (e.g., a still figure or video 
clip) at step 1106. In either case, at step 1107, the sys- 
tem, for example the multimedia server 222 of the BRG 
300, may convert text of an email message to audio us- 
ing for example pattern recognition and voice synthesis 
or use the voice from a voice mail message and morph 
movement of the mouth on the Image to synchronize 
with the voice. Such an approach to converting text and 
audio messages to multimedia messages may provide 
entertainment or Improved communication to the sub- 
scriber In any case, the process may continue by re- 
turning to step 835 so as to provide the converted mes- 
sage(s) to the subscriber. 

[0129] The multimedia messaging service of the 
present invention may also enable a user to sort and/or 
prioritize mail messages based on a variety of user 
specified criteria such as the senders identity, subject 
matter, date sent, priority specified by the sender, cate- 
gory, custom sort (e.g., a "hotword/phrase" in the mes- 
sage body ortitle), etc. Figure 1 3 illustrates one example 
of a GUI that may be used In the present Invention for 
sorting and prioritizing a subscriber's mall. As Indicated, 
by selecting the "Sort By" icon 1301 a list of categories 
may be provided by which the subscriber may select to 
sort mall messages. Some exemplary categories are 
the name of the sender, the sender's address or direc- 
tory number, the subject matter of the message (e.g., 
business, weather, etc), the date the message was re- 
ceived, the priority specified by the sender, and a cus- 
tom feature which allows the subscriber to define the 
sort category. The message sort and prioritize window 
may also include a filter 1302 for setting whether the 
category is sorted using ascending or descending al- 
phanumerical order, or a custom manner defined by the 
subscriber. Section 1303 illustrates a message log that 
may be used in reviewing the sort and prioritize status 
and/or creating a custom sort and/or filter. 
[01 30] Referring to Figures 1 4 and 1 5, the multimedia 
messaging service may further include a multimedia 
message forwarding feature which enables the sub- 
scriber to specify a remote location to which message 
waiting notification will be automatically forward and 
from which the subscriber may Instantaneously review 
the message In whatever media the subscriber selects. 
Figure 1 4 provides one exemplary method for providing 
remote message notification in the broadband networl< 
1 ofthe present invention. Afterthe broadband customer 
p rem Ise 1 ntel ligent transceiver (e. g . , B RG 300) receives 
notification that a message is waiting (step 801 ), at step 
1 401 , the system, for example the BRG 300 or the MS 



222, checks to see if the subscriber has designated a 
remote location to forward his message notification. If 
not, the system returns to the previously described no- 
tification process which provides notification at the sub- 
5 scrlber's system designated location (e.g., at the sub- 
scriber's home or office). However, It the subscriber has 
designated a remote location for message notification, 
the system, for example the BRG 300 or the MS 222 
and the call manager 218 forward a message notifica- 
10 tion to the remote location designated by the subscriber 
at step 1402. For example, the subscriber may forward 
their message notification to their cellular phone when 
they are commuting to and from work or traveling on 
business. Then, at decision step 1403, the system de- 
15 termlnes if the subscriber requested review of messag- 
es waiting at the remote location. If so, then the system 
provides the message log of message(s) waiting to the 
subscriber at the remote location at step 1404. For ex- 
ample, if the system knows that the forward-to DN is a 
20 cellular telephone having only audio capabilities then 
the system, for example the BRG 300 or the MS 222, 
will fonward the message log in audio form and convert 
to audio and forward all the messages the subscriber 
request to review from the remote location. The system 
25 will then return to the normal message notification proc- 
ess. 

[0131] Referring to Figure 15, an exemplary graphical 
user interface (GUI) for entering information into the 
broadband network system for designating message 
30 notification location which may be displayed on, for ex- 
ample, a TV 1 06, a PC 1 08 or display 338 of a BRG 300, 
is provided. This GUI may be used for establishing 
where within the subscriber's CPE the message waiting 
notification will be provided and designate if and where 
35 a remote message waiting notification will be provided. 
The message notification location designation screen 
may be provided to each subscriber account or DN. The 
message notification location designation screen In- 
cludes a Device 1 501 designation for designating where 
40 on the customer (subscriber) premises a notification is 
to be provided and what, if any remote location may re- 
ceive a message waiting notification. Further, the mes- 
sage notification location designation screen may indi- 
cate where the particular device by which notification is 
45 provided is physically located. The message notification 
location designation screen may also include a status 
icon or button 1 503 that may be switched between on 
and off to activate or deactivate message waiting notifi- 
cation at the various selected customer premises and 
50 remote locations. The message notification location 
designation screen may include an information input line 
1 504 which allows the subscnber to identify the remote 
location by entering, for example, a directory number, 
internet protocol system address, email address, etc. 
55 [0132] In addition, the multimedia messaging service 
may enable the user to store the messages at various 
locations such as on their own equipment, e.g., within a 
PC or a BRG, or to archive the message within the sys- 
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tem (possibly for a fee). If system storage is chosen, a 
status report may be provided for space used, available 
space, and charges forthe use of storage. If more space 
is needed, increases maybe requested by the subscrib- 
er in real time and billed to the subscriber accordingly, s 
Alternatively, the storage could be purchased from any 
number of providers in real time on line similar to a com- 
modity purchase. Referring to Figure 16, an exemplary 
graphical user interface (GUI) for entering information 
into the broadband network system for designating mes- io 
sage storage is provided. This GUI may contain two log- 
ical groups of Information Input: standard message stor- 
age section 1601 (e.g., short term) and archive storage 
section 1610 (e.g., long tenn storage). The subscriber 
may, for example, select a message storage device and 
location 1 602 and a storage duration 1 603 for standard 
message storage 1 601 . The subscriber may select one 
status for main standard storage and one status for 
backup standard storage. The standard storage may be 
provided locally in, for example, the memory 322 of BRG 20 
300, a PC 108, or a peripheral storage device such as 
a disk drive or digital video disk (DVD). Alternatively, the 
standard storage may be at a remote location such as 
an IP Central Station 200 central storage device. The 
latter is particularly attractive for when the BRG 300 is 25 
used as a PBX in a business location. Further, the sys- 
tem may provide an activity log which tracks past and 
present messages and/or archived multimedia messag- 
es which may be presented on display 901 . The log may 
keep track of what, who, where, when the message Is so 
retrieved. 

[0133] The archive storage 1610 may provide the 
subscrlberthe ability to designate the message storage 
device and location 1611, the storage duration 1612, 
and the storage trigger 1613 (I.e., how a message Is 35 
designated for archive). The archive messages may be 
stored locally in for example the memory 322 of the BRG 
300, or at a remote location such as a memory associ- 
ated with the multimedia server 222 of the IP central 
200. The archive may be utilized by the subscriber to 40 
recall messages which have long since been erased 
from local storage but may be retrieved from IP central 
station 200 on tape and/or disk storage. 
[0134] The multimedia messaging service may also 
be equipped with a simple userfriendly message waiting 45 
indicator light, located on for example the BRG 300, for 
each IP address, and a one touch multimedia messag- 
ing service message retrieval feature activation which 
may be provide via a display 901 or keypad Input. 
[0135] Thus, the present Invention provides Integral- so 
ed multimedia networks, which may Include voice over 
IP (VoIP), with a user friendly flexible multimedia mes- 
saging service that integrates all types of mail messages 
sothata usercan be notified, identify, retrieve, and store 
all his mail messages with a single service In whatever 55 
media the user wishes. 

[0136] Although particular embodiments of the 
present Invention have been shown and described, It will 



be understood that it is not intended to limitthe invention 
to the preferred embodiments and it will be obvious to 
those skilled in the art that various changes and modi- 
fications may be made without departing from the spirit 
and scope of the present invention. Thus, the invention 
is intended to cover alternatives, modifications, and 
equivalents, which may be included within the spirit and 
scope of the invention as defined by the claims. For ex- 
ample, the subscriber input for programming the various 
feature/functions of the multimedia messaging service 
may be provided using a keypad and automated voice 
prompts rather than graphical user Interfaces and could 
be programmed from a remote location or by a system 
manager. Further, the multimedia messaging service 
could be provided with various default settings by the 
system management server 21 6 of the multimedia serv- 
er 222. 

[0137] Where technical features mentioned In any 
claim are followed by reference signs, those reference 
signs have been included for the sole purpose of in- 
creasing the intelligibility of the claims and accordingly, 
such reference signs do not have any limiting effect on 
the scope of each element identified by way of example 
by such reference signs. 



Claims 

1 . A method for providing multimedia messaging serv- 
ice In an Integrated broadband communication sys- 
tem, comprising the steps of: 

receiving a message of any media type directed 
to a subscriber of said system; 
storing a message according to Its media type 
being one of text, audio, and multimedia audio 
and video; and 

providing a message waiting notification to said 
subscriber at one or more predetermined loca- 
tions, said message waiting notification identi- 
fying said type of said message waiting as one 
of said text, said audio, and said multimedia au- 
dio and video. 

2. The method according to claim 1 , characterised in 
that said step of providing a message waiting noti- 
fication Is directed to equipment located at said sub- 
scriber's premises. 

3. The method according to claim 2, characterised In 
that directing a message waiting notification to said 
customers premises equipment Is provided by a 
multimedia server, said one of said customer 
premises is an intelligent transceiver, and said sub- 
scriber determines which equipment at said sub- 
scriber's premises Is to provide alerting to said sub- 
scriber based on said message waiting notification. 
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4. The method according to claim 3, characterised in 
that said message received is created by a sending 
party and contains an indication of media type so 
that it may be stored according to said media type 
being one of text, audio, and muitimedia audio and 
video. 

5. The method according to claim 4, characterised in 
that said message received is created in real time 
on a multimedia server by a calling party unable to 
reach said subscriber. 

6. The method according to claim 5, further compris- 
ing the step of: 

displaying said message waiting notification on a 
display. 

7. The method according to claim 6, characterised In 
that said display is: 

a display of said intelligent transceiver at said 
customer premises if said intelligent transceiv- 
er has an active display; 
a display of a personal computer at said cus- 
tomer premises if said personal computer is 
turned on; 

a display of a television at said customer 
premises If said television Is turned on. 

8. The method according to claim 5, further compris- 
ing the step of: 

providing an audio message notification to a tele- 
phone If said telephone headset Is off hook. 

9. The method according to claim 6, further compris- 
ing the step of: 

requesting said subscriber's Identification and 
password to give said subscriber a message log of 
said messages waiting. 

10. The method according to claim 9, further compris- 
ing the step of: 

converting at least one of said messages waiting 
from a first media type to a second media type if 
said subscriber has designated a preferred media 
type for reviewing said messages waiting. 

11. The method according to claim 1 0, characterised In 
that said message waiting is converted from text to 
multimedia audio and video using voice synthesis 
and animation so that the animated figure Is syn- 
chronised to the to voice synthesised speech. 

12. The method according to claim 11 , further compris- 
ing the steps of: 

archiving at least one of said messages waiting at 
a subscriber designated location If said subscriber 
has designated the message is to be archived. 



13. The method according to claim 1 , characterised in 
that said step of providing a message waiting noti- 
fication is directed to equipment located remote 
from said subscriber's premises and Is predeter- 

5 mined by said subscriber. 

14. The method according to claim 1 , further compris- 
ing the steps of: 

receiving a call from a calling party directed to said 
10 system subscriber; and prompting said calling party 
Indicating that said message may be created and 
left for said subscriber using any media type. 

1 5. A method for providing multimedia messaging serv- 
es ice in an integrated broadband communication sys- 
tem, comprising the steps of: 

converting at least one message from a first media 
type to a second media type for reviewing messag- 
es. 

16. The method according to claim 15, further compris- 
ing the step of: 

providing a graphical user interface so that said sys- 
tem user can preprogram said system to convert 
25 messages from said first media type to said second 
media type and to sort incoming messages In a 
message log so as to appear in a predetermined 
order according to at least one desired category, 

30 17. A system providing multimedia messaging service 
In an Integrated broadband communication-sys- 
tem, Including: 

a multimedia server providing storage of mes- 
as sages of all media types such as text, audio, 
and multimedia audio and video which are re- 
ceived for a system subscriber; and 
an intelligent transceiver located to said system 
subscriber's premises and operative to receive 
40 a message waiting notification from said muiti- 
media server and alert said subscriber of a 
message awaiting their review, said alert In- 
cluding an indication of said media type of said 
message being text, audio, and multimedia au- 
45 dio and video. 

18. The system according to claim 1 7, characterised In 
that said alert Is provided on a display of: 

so a television coupled to said Intelligent trans- 

ceiver; 

a personal computer coupled to said intelligent 
transceiver. 

55 19. The system according to claim 18, characterised In 
that said intelligent transceiver is a broadband res- 
idential gateway with at least one of: 
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a display that provides said alert; 
an audible alert. 
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FIG, 7B 



from fig.7a 
[a] 



PUYBACK PRE-RECORDED 
GREETING MESSAGE TO 
CALLING PARTY 



-708 



^HAS 
THE CALLED 
PARTY SET A NO 
MESSAGE ALLOWED STATUS 
FOR THE CALLING 
JARTY ' 

[no 



709 



r710 



YES 


DISCONNECT 




THE CALL 



CALLING PARTY MAY GENERATE 
A VOICE MAIL, TEXT MESSAGE, 
OR VIDEO MAIL 

I 



STORE MESSAGE ACCORDING TO 
MEDIA TYPE (TEXT.AUDIO.AUDIO AND VIDEO) 
AND PRIORITY 



-711 



FROM FIG.7A 



PROVIDE CALLED PARTY NOTIFICATION 
OF MESSAGE WAITING USING MULTIMEDIA 
MESSAGING NOTIFICATION 



"712 



-713 



EMAIL, VOICE MAIL, OR 
VIDEO MAIL GENERATED BY 
ANOTHER PARTY AND SENT 
TO BROADBAND SYSTEM 
SUBSCRIBER'S EMAIL 
ADDRESS OR DN 



-714 
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FIG, 8A 



BROADBAND CUSTOMER PREMISE INTELLIGENT 
TRANSCEIVER RECEIVES NOTIFICATION OF 
MESSAGE WAITING 



FROM FIG.8C 



DOES 802 
THE CUSTOMER 
"PREMISE INTELLIGENT TRANSCEIVER^ 
INCLUDE AN ACTIVE DISPUY 
^ND/OR INTERCOM WIIU 

jpeakerj^ 
[yes 



NO , , 
TO FIG. 



SEND MESSAGE WAITING NOTIFICATION TO 

ACTIVE DISPLAY AND/OR INTERCOM 
INDICATING MESSAGE WAITING MEDIA TYPE, 
AND/OR NUMBER OF MESSAGES WAITING 



-803 



TO FIG. 8B 
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FIG, 8B FR0MFIG.8A 

BROADBAND COMMUNICATION SYSTEM (BCS) SUBSCRIBER 
TURNS ON CUSTOMER PREMISES EQUIPMENT (PC,TVJELEPHONE) 




SUBSCRIBERS MESSAGES 
TO FIG.8C 
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FIG, 8C 



FROM FIG.8B 




CONVERT MESSAGE TO BCS PRESENT MESSAGE IN MEDIA 
SUBSCRIBER DESIGNATED MEDIA TYPE BY WHICH 

TYPE AND PRESENT MESSAGE MESSAGE HAS BEEN 

TO BCS SUBSCRIBER ORIGINATED AND/OR STORED 




ARCHIVE MESSAGE IN BCS CENTRAL 
STORAGE. BCS SUBSCRIBER CPE. 

AND/OR BCS SUBSCRIBER " 
DESIGNATED STORAGE LOCATION 
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FIG, 9 



DISPLAY 



902 



MESSAGE BROAD DNI ^>m^l O])))) 1 



DDN1 'M=q2 □]>)); 1 ^\ 



903 

FIO, 10 



904 505 



901 



DISPUY 



MESSAGE CONSOLE LOGIN WINDOW 



DN 

PASSWORD 



OK I ICANCELl 



-1002 



1001- 



NOTIFICATION WINDOW 



2 1 0 
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FIG. 11 



1103 




CONVERT VOICE 
MAIL MESSAGE AND 
AUDIO PORTIONS OF 
MULTIMEDIA MESSAGES 

TO TEXT USING 
VOICE RECOGNITION 



-1101 



1104 



CONVERT EMAIL MESSAGE 
OR TEXT IN VIDEO OR 
MULTIMEDIA MESSAGES 
INTO VOICE MESSAGES 
JSE PAnERN RECOGNITION 
AND VOICE SYNTHESIS 




CONVERT TEXT OF EMAIL 
TO VOICE MESSAGE USING 
PAHERN RECOGNITION AND 
VOICE SYNTHESIS OR USE 
VOICE FROM PHONE-MAIL 
AND MORPH MOVEMENT OF 
MOUTH OF IMAGE TO 
SYNC WITH VOICE 



■ <G0 TO STEP 835 OF FIG.8C> 
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FIG. 12 



MESSAGE TYPE CONVERSION WINDOW 



FROM 



1205^1^ 
1201 



STATUS 



CONVERT FROM: 



CONVERT TO: 



1202 



1203 



FIG, 13 



MESSAGE SORT AND PRIORITIZE WINDOW 



1303 



I SORT BY 1301 
o NAME OF SENDER 
o SENDER'S ADDRESS OR DN 
o SUBJECT OF MESSAGE 
o DATE RECEIVED 
o PRIORITY SPECIFIED BY SENDER 
o CUSTOM 



I FILTER 1 ^1302 



o ASCENDING 
o DESCENDING 
o CUSTOM 



MESSAGE TITLE 


SENDER 


ADDRESS OR DN 


SUBJECT 


DATE 


PRIORITY 


MESSAGE 1 Dd'))) 


SANTA ClAUS 


NORTH POLE 


GOOD/BAD 


11/29 


REGUUR 


MESSAGE 2 [3 


SANTA CLAUS 


NORTH POLE 


GIFTS 


12/23 


HIGH 


MESSAGE 3 "mpt 


JACK FROST 


1-800-500-COLD 


WEATHER 


12/24 


REGUUR 
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FIG. 14 




FORWARD MESSAGE WAITING NOTIFICATION 
TO DESIGNATED REMOTE LOCATION 




PROVIDE MESSAGE WAITING TO 
BOS SUBSCRIBER REMOTE LOCATION 



(go to STEP 802 FIG.SA) - 
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FIG. 15 



MESSAGE NOTIFICATION DESIGNATION SCREEN: DN1 



DEVICE k -1501 



CUSTOMER PREMISE EQUIPMENT: 
BRG 

TELEPHONE PORT 1 
TELEPHONE PORT 2 

PCI * 

I 

TV 
I 

REMOTE LOCATION: 
ENTER DN, IP ADDRESS, AND/OR 
EMAIL ADDRESS 

I EMPLOYEE. AT&TX0rV l504 
[OKirCANCELl 



1 LOCATION 1502 


STATUS 


HOME-CENTRAL 


[0N>-1503 


HOME-MASTER BEDROOM 


[U 


HOME-UVING ROOM 


10 


HOME-STUDY 


d] 


HOME-MASTER BEDROOM 


d] 


REMOTE LOCATION: 




BUSINESS - orncE PC 


[1] 



FIG. 16 



^901 



MESSAGE STORAGE SELECTION WINDOW 



STANDARD STORAGE 



I MESSAGE STORAGE DEVICE AND LOCATION | 
MAIN 

STATUS: PC: HOME-STUDY (PC PORT \) 
BACKUP 

STATUS: IP CENTRAL STATION STORAGE 



-1502 



-1603 



STORAGE DURATION^ 



10 DAYS 
30 DAYS 



ARCHIVE STORAGE 



1611 



1612 



1613 



[MESSAGE STORAGE DEVICE AND L0CAfi0N]| STORAGE DUR]B][ST0R^ TRIGGER | 



STATUS: IP CENTRAL STATION STORAGE CONTINUOUS MANUAL 

SPACE USED:[i6B] AVAIUBLE SPACE: [5GB| C0ST: i$1.25/MIN| 
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